[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:00 dist-test-slave-j2vl krb5kdc[13006](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:00 dist-test-slave-j2vl krb5kdc[13006](info): set up 2 sockets
Aug 06 18:39:00 dist-test-slave-j2vl krb5kdc[13006](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 18:39:01.853302 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.003s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:01 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:02.006537 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34951
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:02.135593 13028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:02.135985 13028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:02.136068 13028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:02.140513 13028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:02.140650 13028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:02.140686 13028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:02.140728 13028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:02.140784 13028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:02.146762 13028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:02.148058 13028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:02.149204 13028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:02.160986 13028 server_base.cc:1034] running on GCE node
W20260806 18:39:02.160989 13041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:02.161304 13040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:02.161010 13043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:02.162165 13028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:02.163450 13028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:02.164690 13028 hybrid_clock.cc:648] HybridClock initialized: now 1786041542164643 us; error 62 us; skew 500 ppm
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041542, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:02.168259 13028 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:02.169492 13028 webserver.cc:460] Webserver started at http://127.12.177.190:39533/ using document root <none> and password file <none>
I20260806 18:39:02.170125 13028 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:02.170228 13028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:02.170495 13028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:02.172971 13028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "632b7a2d8b04425fb6670c157f216f1f"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "07d64a308b604f88faedb4828ddcf46c"
server_key_iv: "0b5bd5d20a4cc1a09c6bfb0762da2f88"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.173861 13028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "632b7a2d8b04425fb6670c157f216f1f"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "07d64a308b604f88faedb4828ddcf46c"
server_key_iv: "0b5bd5d20a4cc1a09c6bfb0762da2f88"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.178784 13028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:39:02.182245 13060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.183957 13028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:02.184168 13028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "632b7a2d8b04425fb6670c157f216f1f"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "07d64a308b604f88faedb4828ddcf46c"
server_key_iv: "0b5bd5d20a4cc1a09c6bfb0762da2f88"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.184335 13028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:02.203258 13028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:02.207157 13028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:02.207432 13028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:02.217564 13028 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:34951
I20260806 18:39:02.217582 13146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:34951 every 8 connection(s)
I20260806 18:39:02.218780 13028 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:02.222121 13147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:02.226917 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13028
I20260806 18:39:02.227061 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:02.228448 12998 external_mini_cluster.cc:1428] Setting key 2dfc601aa14a65a2d0c79ea8a7f6de46
I20260806 18:39:02.230141 13147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f: Bootstrap starting.
I20260806 18:39:02.234555 13147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:02.235793 13147 log.cc:824] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:02.238639 13147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f: No bootstrap required, opened a new log
I20260806 18:39:02.244127 13147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } }
I20260806 18:39:02.244488 13147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:02.244589 13147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b7a2d8b04425fb6670c157f216f1f, State: Initialized, Role: FOLLOWER
I20260806 18:39:02.245127 13147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } }
I20260806 18:39:02.245267 13147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:02.245409 13147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:02.245534 13147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:02.247082 13147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } }
I20260806 18:39:02.247514 13147 leader_election.cc:302] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 632b7a2d8b04425fb6670c157f216f1f; no voters:
I20260806 18:39:02.247939 13147 leader_election.cc:288] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:02.248162 13156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:02.248560 13156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [term 1 LEADER]: Becoming Leader. State: Replica: 632b7a2d8b04425fb6670c157f216f1f, State: Running, Role: LEADER
I20260806 18:39:02.249008 13156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } }
I20260806 18:39:02.249680 13147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:02.251294 13161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 632b7a2d8b04425fb6670c157f216f1f. Latest consensus state: current_term: 1 leader_uuid: "632b7a2d8b04425fb6670c157f216f1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } } }
I20260806 18:39:02.251451 13161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:02.251366 13160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "632b7a2d8b04425fb6670c157f216f1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632b7a2d8b04425fb6670c157f216f1f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34951 } } }
I20260806 18:39:02.251515 13160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:02.252027 13173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:02.257093 13173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:02.263325 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:02.232522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40374 (local address 127.12.177.190:34951)
0806 18:39:02.233216 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:02.233237 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:02.234230 (+ 993us) server_negotiation.cc:407] Connection header received
0806 18:39:02.238442 (+ 4212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:02.238469 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:02.238933 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:02.239366 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:02.242163 (+ 2797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.244013 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.246094 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.246899 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.247118 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:02.253239 (+ 6121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:02.253248 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:02.253265 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:02.253308 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:02.256490 (+ 3182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.257620 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.257628 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.257634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.257811 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.258324 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.258328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.258330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.258931 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:02.259259 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:02.261447 (+ 2188us) server_negotiation.cc:299] Negotiation successful
0806 18:39:02.261802 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":157,"threads_started":1}
I20260806 18:39:02.266899 13173 catalog_manager.cc:1347] Generated new cluster ID: b3a44d53bba74d879c15562108ec63b7
I20260806 18:39:02.266987 13173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:02.287045 13173 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:02.288498 13173 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:02.294559 13173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 632b7a2d8b04425fb6670c157f216f1f: Generated new TSK 0
I20260806 18:39:02.295411 13173 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:02.339116 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:02.488619 13194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:02.488981 13194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:02.489059 13194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:02.493327 13194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:02.493464 13194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:02.493567 13194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:02.499394 13194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:02.500666 13194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:02.501860 13194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:02.513480 13204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:02.513423 13201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:02.513705 13194 server_base.cc:1034] running on GCE node
W20260806 18:39:02.513425 13200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:02.514417 13194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:02.515204 13194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:02.516422 13194 hybrid_clock.cc:648] HybridClock initialized: now 1786041542516398 us; error 38 us; skew 500 ppm
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041542, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:02.520299 13194 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:02.521335 13194 webserver.cc:460] Webserver started at http://127.12.177.129:35209/ using document root <none> and password file <none>
I20260806 18:39:02.522050 13194 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:02.522151 13194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:02.522401 13194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:02.524931 13194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "a591206ea6c741e9aa1f234184413b7b"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "b82567c3d50b563636d2c3fd18d48961"
server_key_iv: "b5840dfcccdf007ddae5200f7b4a797f"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.525667 13194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "a591206ea6c741e9aa1f234184413b7b"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "b82567c3d50b563636d2c3fd18d48961"
server_key_iv: "b5840dfcccdf007ddae5200f7b4a797f"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.530216 13194 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 18:39:02.533079 13213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.534629 13194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:39:02.534832 13194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "a591206ea6c741e9aa1f234184413b7b"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "b82567c3d50b563636d2c3fd18d48961"
server_key_iv: "b5840dfcccdf007ddae5200f7b4a797f"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.534992 13194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:02.556160 13194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:02.560645 13194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:02.561008 13194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:02.562026 13194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:02.563179 13194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:02.563263 13194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.563342 13194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:02.563409 13194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.582883 13194 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:44955
I20260806 18:39:02.582932 13387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:44955 every 8 connection(s)
I20260806 18:39:02.583974 13194 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:02.589411 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13194
I20260806 18:39:02.589553 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:02.589851 12998 external_mini_cluster.cc:1428] Setting key 920f4de9ff217c1c1cf8e9d732fea34b
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041542, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:02.603492 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:02.586115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42773 (local address 127.12.177.190:34951)
0806 18:39:02.586296 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:02.586301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:02.587746 (+ 1445us) server_negotiation.cc:407] Connection header received
0806 18:39:02.588718 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:02.588722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:02.588774 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:02.588891 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:02.590654 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.591403 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.593264 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.593803 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.594001 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:02.598488 (+ 4487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:02.598496 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:02.598502 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:02.598557 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:02.600529 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.601414 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.601420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.601425 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.601551 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.601976 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.601982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.601987 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.602280 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:02.602416 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:02.603094 (+ 678us) server_negotiation.cc:299] Negotiation successful
0806 18:39:02.603271 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 18:39:02.604547 13390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:02.586594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34951 (local address 127.12.177.129:42773)
0806 18:39:02.587562 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:02.587611 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:02.588424 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:02.589121 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:02.589131 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:02.589711 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:02.590464 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:02.590483 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.591550 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.591553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:02.593082 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:02.593100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.594223 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.594235 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:02.594482 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:02.595572 (+ 1090us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:02.595592 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:02.598031 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:02.600749 (+ 2718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:02.600760 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:02.600787 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:02.601218 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:02.601676 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:02.601679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:02.601680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:02.601873 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:02.602439 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:02.602447 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:02.602794 (+ 347us) client_negotiation.cc:769] Sending connection context
0806 18:39:02.603007 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 18:39:02.603424 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":581,"threads_started":1}
I20260806 18:39:02.606323 13388 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34951
I20260806 18:39:02.606616 13388 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:02.607311 13388 heartbeater.cc:511] Master 127.12.177.190:34951 requested a full tablet report, sending...
I20260806 18:39:02.609632 13092 ts_manager.cc:194] Registered new tserver with Master: a591206ea6c741e9aa1f234184413b7b (127.12.177.129:44955)
I20260806 18:39:02.610998 13092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:42773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:02.630716 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:02.808126 13396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:02.808485 13396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:02.808573 13396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:02.813769 13396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:02.813884 13396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:02.813985 13396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:02.820175 13396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:02.821591 13396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:02.822741 13396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:02.834885 13409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:02.835011 13407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:02.834815 13406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:02.835132 13396 server_base.cc:1034] running on GCE node
I20260806 18:39:02.835666 13396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:02.836434 13396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:02.837646 13396 hybrid_clock.cc:648] HybridClock initialized: now 1786041542837625 us; error 34 us; skew 500 ppm
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041542, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:02.841758 13396 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:02.842859 13396 webserver.cc:460] Webserver started at http://127.12.177.130:37507/ using document root <none> and password file <none>
I20260806 18:39:02.843516 13396 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:02.843590 13396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:02.843788 13396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:02.846756 13396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "2e2e93ffbce5460a879d479d62f8341a"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "2b48236b56455437e238d645fa9f42a7"
server_key_iv: "7e652167fa3ffd149f88a584e658510c"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.847440 13396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "2e2e93ffbce5460a879d479d62f8341a"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "2b48236b56455437e238d645fa9f42a7"
server_key_iv: "7e652167fa3ffd149f88a584e658510c"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.852468 13396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:39:02.855607 13420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.857112 13396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:02.857246 13396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "2e2e93ffbce5460a879d479d62f8341a"
format_stamp: "Formatted at 2026-08-06 18:39:02 on dist-test-slave-j2vl"
server_key: "2b48236b56455437e238d645fa9f42a7"
server_key_iv: "7e652167fa3ffd149f88a584e658510c"
server_key_version: "encryptionkey@0"
I20260806 18:39:02.857467 13396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:02.877226 13396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:02.881433 13396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:02.881734 13396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:02.882570 13396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:02.883584 13396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:02.883636 13396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.883679 13396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:02.883695 13396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:02.902904 13396 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:35693
I20260806 18:39:02.902940 13581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:35693 every 8 connection(s)
I20260806 18:39:02.904011 13396 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:02.912528 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13396
I20260806 18:39:02.912690 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:02.914022 12998 external_mini_cluster.cc:1428] Setting key 016209417c6f7e1dc812fc6fd0b5688d
Aug 06 18:39:02 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041542, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:02.922362 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:02.906407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:52705 (local address 127.12.177.190:34951)
0806 18:39:02.906588 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:02.906592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:02.907934 (+ 1342us) server_negotiation.cc:407] Connection header received
0806 18:39:02.908928 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:02.908931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:02.908987 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:02.909073 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:02.910614 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.911207 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.912871 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.913595 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.913757 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:02.917767 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:02.917770 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:02.917772 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:02.917803 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:02.919712 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.920409 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.920414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.920416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.920523 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:02.920943 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:02.920947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:02.920949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:02.921185 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:02.921310 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:02.922020 (+ 710us) server_negotiation.cc:299] Negotiation successful
0806 18:39:02.922179 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 18:39:02.923596 13585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:02.906817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34951 (local address 127.12.177.130:52705)
0806 18:39:02.907721 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:02.907770 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:02.908652 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:02.909328 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:02.909393 (+ 65us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:02.909843 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:02.910411 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:02.910428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.911357 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.911360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:02.912369 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:02.912383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:02.913834 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:02.913839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:02.914075 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:02.915269 (+ 1194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:02.915299 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:02.917534 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:02.919894 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:02.919903 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:02.919932 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:02.920281 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:02.920635 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:02.920638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:02.920640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:02.920825 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:02.921310 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:02.921319 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:02.921703 (+ 384us) client_negotiation.cc:769] Sending connection context
0806 18:39:02.921957 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 18:39:02.922378 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":244,"threads_started":1}
I20260806 18:39:02.925335 13582 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34951
I20260806 18:39:02.925701 13582 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:02.926318 13582 heartbeater.cc:511] Master 127.12.177.190:34951 requested a full tablet report, sending...
I20260806 18:39:02.927585 13092 ts_manager.cc:194] Registered new tserver with Master: 2e2e93ffbce5460a879d479d62f8341a (127.12.177.130:35693)
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:02.928282 13092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:52705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:02.953711 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:03.125504 13588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:03.125850 13588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:03.125902 13588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:03.130666 13588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:03.130774 13588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:03.130844 13588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:03.137436 13588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34951
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:03.138701 13588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:03.139894 13588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:03.153132 13601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:03.153054 13597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:03.153081 13598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:03.153502 13588 server_base.cc:1034] running on GCE node
I20260806 18:39:03.154048 13588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:03.154840 13588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:03.156061 13588 hybrid_clock.cc:648] HybridClock initialized: now 1786041543156026 us; error 49 us; skew 500 ppm
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:03.160037 13588 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:03.161087 13588 webserver.cc:460] Webserver started at http://127.12.177.131:44655/ using document root <none> and password file <none>
I20260806 18:39:03.161896 13588 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:03.161998 13588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:03.162268 13588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:03.164978 13588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "884cfbfb57234aadb7316b32ce9c80a9"
format_stamp: "Formatted at 2026-08-06 18:39:03 on dist-test-slave-j2vl"
server_key: "7afaf4f8b4649678ba4709d867253eff"
server_key_iv: "d66e45374e2b0115c4599fbafaf4410c"
server_key_version: "encryptionkey@0"
I20260806 18:39:03.165755 13588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "884cfbfb57234aadb7316b32ce9c80a9"
format_stamp: "Formatted at 2026-08-06 18:39:03 on dist-test-slave-j2vl"
server_key: "7afaf4f8b4649678ba4709d867253eff"
server_key_iv: "d66e45374e2b0115c4599fbafaf4410c"
server_key_version: "encryptionkey@0"
I20260806 18:39:03.170676 13588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 18:39:03.173977 13615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:03.176419 13588 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260806 18:39:03.176606 13588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "884cfbfb57234aadb7316b32ce9c80a9"
format_stamp: "Formatted at 2026-08-06 18:39:03 on dist-test-slave-j2vl"
server_key: "7afaf4f8b4649678ba4709d867253eff"
server_key_iv: "d66e45374e2b0115c4599fbafaf4410c"
server_key_version: "encryptionkey@0"
I20260806 18:39:03.176760 13588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:03.192224 13588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:03.195783 13588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:03.196079 13588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:03.196939 13588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:03.198060 13588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:03.198139 13588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:03.198210 13588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:03.198258 13588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:03.221140 13588 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:34683
I20260806 18:39:03.221217 13785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:34683 every 8 connection(s)
I20260806 18:39:03.222291 13588 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:03.224483 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13588
I20260806 18:39:03.224624 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:03.224923 12998 external_mini_cluster.cc:1428] Setting key 50d0ded29e4ebc52906d23f24d0f14d5
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:03.240360 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:03.224877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:46997 (local address 127.12.177.190:34951)
0806 18:39:03.225019 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:03.225024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:03.226740 (+ 1716us) server_negotiation.cc:407] Connection header received
0806 18:39:03.228104 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:03.228107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:03.228156 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:03.228233 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:03.230175 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.230734 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.232543 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.232774 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.232907 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:03.236030 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:03.236034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:03.236036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:03.236064 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:03.237621 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.238242 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.238245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.238247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.238331 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.238814 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.238818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.238819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.239103 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:03.239235 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:03.240004 (+ 769us) server_negotiation.cc:299] Negotiation successful
0806 18:39:03.240158 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:39:03.241504 13789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:03.225380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34951 (local address 127.12.177.131:46997)
0806 18:39:03.226551 (+ 1171us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:03.226614 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:03.227850 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:03.228461 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:03.228470 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:03.229140 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:03.230021 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:03.230045 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.230868 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.230871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:03.232399 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:03.232410 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.232929 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.232931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:03.233095 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:03.233818 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:03.233837 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:03.235796 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:03.237761 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:03.237768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:03.237789 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:03.238114 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:03.238428 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:03.238432 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:03.238434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:03.238660 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:03.239235 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:03.239245 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:03.239616 (+ 371us) client_negotiation.cc:769] Sending connection context
0806 18:39:03.239861 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 18:39:03.240283 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"thread_start_us":270,"threads_started":1}
I20260806 18:39:03.242914 13787 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34951
I20260806 18:39:03.243212 13787 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:03.243794 13787 heartbeater.cc:511] Master 127.12.177.190:34951 requested a full tablet report, sending...
I20260806 18:39:03.244930 13092 ts_manager.cc:194] Registered new tserver with Master: 884cfbfb57234aadb7316b32ce9c80a9 (127.12.177.131:34683)
I20260806 18:39:03.245589 13092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:46997
I20260806 18:39:03.252170 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:03.285264 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:03.273610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53140 (local address 127.12.177.129:44955)
0806 18:39:03.273954 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:03.273963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:03.273995 (+ 32us) server_negotiation.cc:407] Connection header received
0806 18:39:03.274177 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:03.274184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:03.274484 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:03.274655 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:03.275471 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.276401 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.277314 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.277843 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.277981 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:03.280748 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:03.280762 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:03.280783 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:03.280816 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:03.283084 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.283639 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.283645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.283646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.283737 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.284061 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.284065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.284067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.284363 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:03.284608 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:03.284840 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 18:39:03.285019 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":106,"threads_started":1}
W20260806 18:39:03.286526 13255 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53140
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:03.320498 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:03.310339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53154 (local address 127.12.177.129:44955)
0806 18:39:03.310553 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:03.310558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:03.310694 (+ 136us) server_negotiation.cc:407] Connection header received
0806 18:39:03.310887 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:03.310891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:03.310937 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:03.311035 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:03.311852 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.312388 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.313315 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:03.313611 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:03.313734 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:03.316707 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:03.316710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:03.316713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:03.316748 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:03.318511 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.319084 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.319087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.319088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.319190 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:03.319474 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:03.319477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:03.319478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:03.319672 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:03.319786 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:03.320206 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 18:39:03.320356 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 18:39:03.321856 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13194
I20260806 18:39:03.357800 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13396
I20260806 18:39:03.371012 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13588
I20260806 18:39:03.384764 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13028
2026-08-06T18:39:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2924 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13803](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13803](info): set up 2 sockets
Aug 06 18:39:03 dist-test-slave-j2vl krb5kdc[13803](info): commencing operation
krb5kdc: starting...
W20260806 18:39:04.689105 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:04 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:04.833709 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:42331
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:43145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:42331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:04.960289 13824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:04.960687 13824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:04.960774 13824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:04.965209 13824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:04.965453 13824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:04.965559 13824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:04.965605 13824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:04.965647 13824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:04.972079 13824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:43145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:42331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:42331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:04.973438 13824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:04.974602 13824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:04.984495 13833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:04.984613 13831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:04.984575 13835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:04.984933 13824 server_base.cc:1034] running on GCE node
I20260806 18:39:04.985764 13824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:04.987121 13824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:04.988358 13824 hybrid_clock.cc:648] HybridClock initialized: now 1786041544988320 us; error 54 us; skew 500 ppm
Aug 06 18:39:04 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041544, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:04.992239 13824 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:04.993669 13824 webserver.cc:460] Webserver started at http://127.12.177.190:42761/ using document root <none> and password file <none>
I20260806 18:39:04.994365 13824 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:04.994441 13824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:04.994689 13824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:04.998600 13824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "6e0542bd48da41d08e6424cd4fd115e6"
format_stamp: "Formatted at 2026-08-06 18:39:04 on dist-test-slave-j2vl"
server_key: "f50a2bc4ef8f8e55e71d97a2a6fe63f9"
server_key_iv: "dcec77677ec07e67b820b9b9ad536829"
server_key_version: "encryptionkey@0"
I20260806 18:39:04.999401 13824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "6e0542bd48da41d08e6424cd4fd115e6"
format_stamp: "Formatted at 2026-08-06 18:39:04 on dist-test-slave-j2vl"
server_key: "f50a2bc4ef8f8e55e71d97a2a6fe63f9"
server_key_iv: "dcec77677ec07e67b820b9b9ad536829"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.004101 13824 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:05.007227 13844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.008970 13824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:05.009173 13824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "6e0542bd48da41d08e6424cd4fd115e6"
format_stamp: "Formatted at 2026-08-06 18:39:04 on dist-test-slave-j2vl"
server_key: "f50a2bc4ef8f8e55e71d97a2a6fe63f9"
server_key_iv: "dcec77677ec07e67b820b9b9ad536829"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.009333 13824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:05.025104 13824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:05.029160 13824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:05.029456 13824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:05.038072 13824 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:42331
I20260806 18:39:05.038381 13913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:42331 every 8 connection(s)
I20260806 18:39:05.039250 13824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:05.042692 13914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:05.042899 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13824
I20260806 18:39:05.043030 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:05.043308 12998 external_mini_cluster.cc:1428] Setting key df2001eec5a5a47fcd37bd888cd449d3
I20260806 18:39:05.050835 13914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6: Bootstrap starting.
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:05.054049 13914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:05.055094 13914 log.cc:824] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:05.057798 13914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6: No bootstrap required, opened a new log
I20260806 18:39:05.060141 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.044775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54244 (local address 127.12.177.190:42331)
0806 18:39:05.045233 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.045249 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.045286 (+ 37us) server_negotiation.cc:407] Connection header received
0806 18:39:05.046275 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.046299 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.046684 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.047220 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:05.048324 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.049475 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.050735 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.051342 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.051482 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.054660 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:05.054667 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:05.054686 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:05.054741 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:05.056801 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.057428 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.057433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.057438 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.057582 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.057937 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.057941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.057943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.058400 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:05.058558 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.058906 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.059300 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":161,"threads_started":1}
I20260806 18:39:05.062110 13914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } }
I20260806 18:39:05.062443 13914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:05.062494 13914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0542bd48da41d08e6424cd4fd115e6, State: Initialized, Role: FOLLOWER
I20260806 18:39:05.062999 13914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } }
I20260806 18:39:05.063185 13914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:05.063261 13914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:05.063375 13914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:05.064453 13914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } }
I20260806 18:39:05.064863 13914 leader_election.cc:302] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e0542bd48da41d08e6424cd4fd115e6; no voters:
I20260806 18:39:05.065315 13914 leader_election.cc:288] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:05.065433 13923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:05.065694 13923 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [term 1 LEADER]: Becoming Leader. State: Replica: 6e0542bd48da41d08e6424cd4fd115e6, State: Running, Role: LEADER
I20260806 18:39:05.066061 13923 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } }
I20260806 18:39:05.066740 13914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:05.068042 13926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e0542bd48da41d08e6424cd4fd115e6. Latest consensus state: current_term: 1 leader_uuid: "6e0542bd48da41d08e6424cd4fd115e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } } }
I20260806 18:39:05.068223 13926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:05.068518 13924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e0542bd48da41d08e6424cd4fd115e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e0542bd48da41d08e6424cd4fd115e6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42331 } } }
I20260806 18:39:05.068615 13924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:05.068748 13937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:05.072254 13937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:05.079052 13937 catalog_manager.cc:1347] Generated new cluster ID: ac58efbb17c048f8a9e4ac2e5fd329ff
I20260806 18:39:05.079174 13937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:05.096040 13937 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:05.097144 13937 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:05.103715 13937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e0542bd48da41d08e6424cd4fd115e6: Generated new TSK 0
I20260806 18:39:05.104584 13937 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:05.154999 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:43145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:05.284104 13957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:05.284391 13957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:05.284438 13957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:05.288574 13957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:05.288654 13957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:05.288717 13957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:05.294708 13957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:43145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:05.295964 13957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:05.297071 13957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:05.308189 13957 server_base.cc:1034] running on GCE node
W20260806 18:39:05.308177 13967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:05.308390 13966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:05.308177 13969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:05.308897 13957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:05.309743 13957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:05.310992 13957 hybrid_clock.cc:648] HybridClock initialized: now 1786041545310952 us; error 55 us; skew 500 ppm
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:05.314373 13957 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:05.315541 13957 webserver.cc:460] Webserver started at http://127.12.177.129:39915/ using document root <none> and password file <none>
I20260806 18:39:05.316241 13957 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:05.316351 13957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:05.316620 13957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:05.319206 13957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "458df8f2127b4e439b8cf9579f9b2ec2"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "8efab068650896de8dbe7963879fa7d3"
server_key_iv: "6f73bad3a928642d49156bf38da3e6ad"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.319928 13957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "458df8f2127b4e439b8cf9579f9b2ec2"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "8efab068650896de8dbe7963879fa7d3"
server_key_iv: "6f73bad3a928642d49156bf38da3e6ad"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.324517 13957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:05.327589 13977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.329025 13957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 18:39:05.329207 13957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "458df8f2127b4e439b8cf9579f9b2ec2"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "8efab068650896de8dbe7963879fa7d3"
server_key_iv: "6f73bad3a928642d49156bf38da3e6ad"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.329349 13957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:05.349321 13957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:05.353165 13957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:05.353550 13957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:05.354282 13957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:05.355437 13957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:05.355520 13957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.355599 13957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:05.355655 13957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.367887 13957 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:38429
I20260806 18:39:05.367928 14167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:38429 every 8 connection(s)
I20260806 18:39:05.369130 13957 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:05.374581 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13957
I20260806 18:39:05.374733 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:05.375020 12998 external_mini_cluster.cc:1428] Setting key a4d09a424f22bcf4a7945349adb58df9
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:05.387698 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.371317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:50879 (local address 127.12.177.190:42331)
0806 18:39:05.371530 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.371534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.372565 (+ 1031us) server_negotiation.cc:407] Connection header received
0806 18:39:05.374053 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.374056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.374125 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.374228 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:05.376452 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.377067 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.379035 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.379470 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.379611 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.383119 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:05.383123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:05.383125 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:05.383155 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:05.384820 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.385667 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.385670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.385672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.385765 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.386263 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.386266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.386268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.386504 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:05.386601 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.387420 (+ 819us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.387557 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 18:39:05.388675 14172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.371732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42331 (local address 127.12.177.129:50879)
0806 18:39:05.372348 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.372414 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.373780 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.374681 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.374693 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.375568 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:05.376225 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.376270 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.377226 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.377232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.378836 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.378853 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.379670 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.379673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.379870 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.380664 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:05.380687 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:05.382851 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:05.384975 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.384983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.385008 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.385518 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.385875 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.385882 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.385886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.386118 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.386637 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:05.386644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:05.387057 (+ 413us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.387297 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.387623 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":152,"threads_started":1}
I20260806 18:39:05.390516 14168 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42331
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:05.390815 14168 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:05.391387 14168 heartbeater.cc:511] Master 127.12.177.190:42331 requested a full tablet report, sending...
I20260806 18:39:05.393379 13861 ts_manager.cc:194] Registered new tserver with Master: 458df8f2127b4e439b8cf9579f9b2ec2 (127.12.177.129:38429)
I20260806 18:39:05.394754 13861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:50879
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:05.414433 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:43145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:05.543078 14176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:05.543465 14176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:05.543565 14176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:05.547940 14176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:05.548063 14176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:05.548164 14176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:05.554028 14176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:43145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:05.555322 14176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:05.556468 14176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:05.567731 14183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:05.567867 14189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:05.567731 14182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:05.567867 14176 server_base.cc:1034] running on GCE node
I20260806 18:39:05.568598 14176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:05.569437 14176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:05.570634 14176 hybrid_clock.cc:648] HybridClock initialized: now 1786041545570625 us; error 33 us; skew 500 ppm
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:05.578401 14176 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:05.579551 14176 webserver.cc:460] Webserver started at http://127.12.177.130:34479/ using document root <none> and password file <none>
I20260806 18:39:05.580195 14176 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:05.580298 14176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:05.580564 14176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:05.583396 14176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "e4c5ed05378e4dccb7380f818179e4e8"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "9fe1d1e2461afba7a53935b45b810dfc"
server_key_iv: "3b5baa7bb4a8736605bbb90fce1f3e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.584146 14176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "e4c5ed05378e4dccb7380f818179e4e8"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "9fe1d1e2461afba7a53935b45b810dfc"
server_key_iv: "3b5baa7bb4a8736605bbb90fce1f3e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.588714 14176 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 18:39:05.591849 14202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.593763 14176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 18:39:05.594054 14176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "e4c5ed05378e4dccb7380f818179e4e8"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "9fe1d1e2461afba7a53935b45b810dfc"
server_key_iv: "3b5baa7bb4a8736605bbb90fce1f3e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.594238 14176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:05.614404 14176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:05.618732 14176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:05.619027 14176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:05.619745 14176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:05.620783 14176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:05.620862 14176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.620939 14176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:05.620982 14176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.631788 14176 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:35867
I20260806 18:39:05.631832 14372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:35867 every 8 connection(s)
I20260806 18:39:05.632846 14176 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:05.634042 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14176
I20260806 18:39:05.634173 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:05.634469 12998 external_mini_cluster.cc:1428] Setting key b5cbfbc86c30d18d8f131f9e71ab27d6
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:05.650873 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.635303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:57679 (local address 127.12.177.190:42331)
0806 18:39:05.635466 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.635470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.636717 (+ 1247us) server_negotiation.cc:407] Connection header received
0806 18:39:05.638379 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.638382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.638440 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.638534 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:05.640402 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.640969 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.642387 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.642640 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.642766 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.645830 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:05.645837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:05.645844 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:05.645891 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:05.647748 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.648492 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.648496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.648497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.648625 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.649089 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.649097 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.649098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.649524 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:05.649651 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.650402 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.650584 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:39:05.651683 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.635823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42331 (local address 127.12.177.130:57679)
0806 18:39:05.636518 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.636584 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.638058 (+ 1474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.638802 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.638815 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.639467 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:05.640201 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.640220 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.641141 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.641144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.642219 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.642232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.642843 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.642857 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.643062 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.643790 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:05.643809 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:05.645550 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:05.647935 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.647943 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.647962 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.648291 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.648717 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.648720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.648721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.648917 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.649722 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:05.649733 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:05.650079 (+ 346us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.650271 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.650614 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":159,"threads_started":1}
I20260806 18:39:05.653146 14373 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42331
I20260806 18:39:05.653512 14373 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:05.654131 14373 heartbeater.cc:511] Master 127.12.177.190:42331 requested a full tablet report, sending...
I20260806 18:39:05.655493 13861 ts_manager.cc:194] Registered new tserver with Master: e4c5ed05378e4dccb7380f818179e4e8 (127.12.177.130:35867)
I20260806 18:39:05.656459 13861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:57679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:05.673668 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:43145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:05.802224 14379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:05.802513 14379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:05.802561 14379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:05.806651 14379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:05.806720 14379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:05.806788 14379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:05.812801 14379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:43145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:05.814138 14379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:05.815269 14379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:05.825657 14386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:05.825850 14379 server_base.cc:1034] running on GCE node
W20260806 18:39:05.825672 14390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:05.826112 14387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:05.826642 14379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:05.827365 14379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:05.828533 14379 hybrid_clock.cc:648] HybridClock initialized: now 1786041545828513 us; error 36 us; skew 500 ppm
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:05.831840 14379 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:05.832993 14379 webserver.cc:460] Webserver started at http://127.12.177.131:37413/ using document root <none> and password file <none>
I20260806 18:39:05.833804 14379 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:05.833956 14379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:05.834196 14379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:05.836591 14379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "cfbcafad1eda4794b21fc20e369d3b45"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "ee94e88369a1b9fed938787aaf3350e5"
server_key_iv: "ea17865e9b1f1a55e4f8f457c82aff30"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.837253 14379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "cfbcafad1eda4794b21fc20e369d3b45"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "ee94e88369a1b9fed938787aaf3350e5"
server_key_iv: "ea17865e9b1f1a55e4f8f457c82aff30"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.842070 14379 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:39:05.845932 14402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.847491 14379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:05.847695 14379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "cfbcafad1eda4794b21fc20e369d3b45"
format_stamp: "Formatted at 2026-08-06 18:39:05 on dist-test-slave-j2vl"
server_key: "ee94e88369a1b9fed938787aaf3350e5"
server_key_iv: "ea17865e9b1f1a55e4f8f457c82aff30"
server_key_version: "encryptionkey@0"
I20260806 18:39:05.847852 14379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:05.878729 14379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:05.882688 14379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:05.882969 14379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:05.883679 14379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:05.884764 14379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:05.884845 14379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.884923 14379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:05.884968 14379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:05.894920 14379 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:34765
I20260806 18:39:05.894945 14569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:34765 every 8 connection(s)
I20260806 18:39:05.895931 14379 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:05.903833 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14379
I20260806 18:39:05.904104 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:05.904402 12998 external_mini_cluster.cc:1428] Setting key c4bec2a9438b93d4f312525085197acf
Aug 06 18:39:05 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041545, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:05.911347 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.897967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:46017 (local address 127.12.177.190:42331)
0806 18:39:05.898165 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.898171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.899190 (+ 1019us) server_negotiation.cc:407] Connection header received
0806 18:39:05.900637 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.900641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.900700 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.900792 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:05.902221 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.902809 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.904017 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.904364 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.904485 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.907535 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:05.907539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:05.907542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:05.907579 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:05.908990 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.909655 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.909659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.909660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.909768 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.910151 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.910154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.910156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.910370 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:05.910488 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.911038 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.911176 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 18:39:05.912277 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.898370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42331 (local address 127.12.177.131:46017)
0806 18:39:05.898941 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.899035 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.900378 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.900980 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.900987 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.901480 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:05.902046 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.902062 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.902936 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.902938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.903856 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.903865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.904566 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.904571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.904746 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.905506 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:05.905524 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:05.907348 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:05.909135 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.909142 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.909161 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.909539 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.909870 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:05.909873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:05.909875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:05.910042 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:05.910488 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:05.910496 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:05.910781 (+ 285us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.910980 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.911353 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":122,"threads_started":1}
I20260806 18:39:05.913731 14570 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42331
I20260806 18:39:05.914090 14570 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:05.914772 14570 heartbeater.cc:511] Master 127.12.177.190:42331 requested a full tablet report, sending...
I20260806 18:39:05.915962 13861 ts_manager.cc:194] Registered new tserver with Master: cfbcafad1eda4794b21fc20e369d3b45 (127.12.177.131:34765)
I20260806 18:39:05.916605 13861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:46017
I20260806 18:39:05.919031 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:39:05.931030 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.922915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49276 (local address 127.12.177.190:42331)
0806 18:39:05.923096 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.923100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.923293 (+ 193us) server_negotiation.cc:407] Connection header received
0806 18:39:05.923403 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.923405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.923453 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.923535 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:05.924276 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.924805 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.925815 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.926070 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.926158 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.927653 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:05.927656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:05.927659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:05.927687 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:05.929136 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.929667 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.929670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.929671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.929782 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:05.930134 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:05.930136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:05.930138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:05.930394 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:05.930506 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.930782 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.930896 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 18:39:05.936743 13861 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:05.940052 13861 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:05.957470 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.950164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52554 (local address 127.12.177.129:38429)
0806 18:39:05.950513 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.950522 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.950851 (+ 329us) server_negotiation.cc:407] Connection header received
0806 18:39:05.951181 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.951188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.951440 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.951579 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:05.952454 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953477 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.955517 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.956398 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.956542 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.956693 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.957140 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.957259 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":108,"threads_started":1}
I20260806 18:39:05.957491 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.950121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:35867 (local address 127.0.0.1:49412)
0806 18:39:05.950854 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.950870 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.950981 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.951887 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.951890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.951903 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:05.952191 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.952200 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953748 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.953751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.955529 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.955537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.956573 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.956577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.956866 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.956944 (+ 78us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.957080 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.957265 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":353,"spinlock_wait_cycles":1920,"thread_start_us":87,"threads_started":1}
I20260806 18:39:05.957491 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.950040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38429 (local address 127.0.0.1:52554)
0806 18:39:05.950687 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.950750 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.950981 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.951831 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.951863 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.951894 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:05.952191 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.952298 (+ 107us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953597 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.953603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.955382 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.955392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.956573 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.956577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.956868 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.956944 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.957080 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.957271 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":734,"thread_start_us":104,"threads_started":1}
I20260806 18:39:05.958362 14586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.950829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:34765 (local address 127.0.0.1:37012)
0806 18:39:05.951438 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:05.951453 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:05.951549 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:05.952575 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:05.952578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:05.952600 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:05.952700 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.952707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953937 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.953940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.955518 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:05.955533 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.957933 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.957937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:05.958034 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.958065 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 18:39:05.958143 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 18:39:05.958227 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":109,"thread_start_us":108,"threads_started":1}
I20260806 18:39:05.958460 14588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.950950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.12.177.130:35867)
0806 18:39:05.951356 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.951371 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.951397 (+ 26us) server_negotiation.cc:407] Connection header received
0806 18:39:05.951480 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.951486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.951674 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.951894 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:05.952393 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953603 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.955660 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.956418 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.956542 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.956693 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.958184 (+ 1491us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.958307 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":102,"threads_started":1}
I20260806 18:39:05.958828 14590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:05.951257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37012 (local address 127.12.177.131:34765)
0806 18:39:05.951755 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:05.952102 (+ 347us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:05.952129 (+ 27us) server_negotiation.cc:407] Connection header received
0806 18:39:05.952206 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:05.952211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:05.952423 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:05.952574 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:05.952790 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.953849 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.956780 (+ 2931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:05.957581 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:05.957712 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:05.957872 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:05.958545 (+ 673us) server_negotiation.cc:299] Negotiation successful
0806 18:39:05.958666 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":160,"threads_started":1}
I20260806 18:39:05.961164 14274 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa74d223cca4f67987588148df276e6 (DEFAULT_TABLE table=test-table [id=c9f84e1b866140e0aef0cde9e0f6db51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:05.961283 14058 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa74d223cca4f67987588148df276e6 (DEFAULT_TABLE table=test-table [id=c9f84e1b866140e0aef0cde9e0f6db51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:05.961521 14472 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa74d223cca4f67987588148df276e6 (DEFAULT_TABLE table=test-table [id=c9f84e1b866140e0aef0cde9e0f6db51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:05.962476 14274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa74d223cca4f67987588148df276e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:05.962482 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa74d223cca4f67987588148df276e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:05.962479 14472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa74d223cca4f67987588148df276e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:05.970149 14591 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Bootstrap starting.
I20260806 18:39:05.972587 14593 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Bootstrap starting.
I20260806 18:39:05.973188 14591 tablet_bootstrap.cc:654] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:05.973758 14594 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Bootstrap starting.
I20260806 18:39:05.974839 14591 log.cc:824] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:05.976704 14594 tablet_bootstrap.cc:654] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:05.977710 14593 tablet_bootstrap.cc:654] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:05.977838 14591 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: No bootstrap required, opened a new log
I20260806 18:39:05.978161 14591 ts_tablet_manager.cc:1397] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260806 18:39:05.978467 14594 log.cc:824] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:05.979305 14593 log.cc:824] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:05.980885 14594 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: No bootstrap required, opened a new log
I20260806 18:39:05.981104 14594 ts_tablet_manager.cc:1397] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 18:39:05.982090 14593 tablet_bootstrap.cc:492] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: No bootstrap required, opened a new log
I20260806 18:39:05.982386 14593 ts_tablet_manager.cc:1397] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 18:39:05.985095 14591 raft_consensus.cc:348] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.985641 14591 raft_consensus.cc:374] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:05.985738 14591 raft_consensus.cc:729] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c5ed05378e4dccb7380f818179e4e8, State: Initialized, Role: FOLLOWER
I20260806 18:39:05.986420 14591 consensus_queue.cc:260] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.987411 14373 heartbeater.cc:503] Master 127.12.177.190:42331 was elected leader, sending a full tablet report...
I20260806 18:39:05.987162 14594 raft_consensus.cc:348] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.987528 14594 raft_consensus.cc:374] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:05.987579 14594 raft_consensus.cc:729] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbcafad1eda4794b21fc20e369d3b45, State: Initialized, Role: FOLLOWER
I20260806 18:39:05.987977 14591 ts_tablet_manager.cc:1428] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260806 18:39:05.988057 14594 consensus_queue.cc:260] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.989197 14594 ts_tablet_manager.cc:1428] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Time spent starting tablet: real 0.008s user 0.000s sys 0.009s
I20260806 18:39:05.989295 14570 heartbeater.cc:503] Master 127.12.177.190:42331 was elected leader, sending a full tablet report...
I20260806 18:39:05.989732 14593 raft_consensus.cc:348] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.989997 14593 raft_consensus.cc:374] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:05.990048 14593 raft_consensus.cc:729] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458df8f2127b4e439b8cf9579f9b2ec2, State: Initialized, Role: FOLLOWER
I20260806 18:39:05.990545 14593 consensus_queue.cc:260] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:05.991724 14593 ts_tablet_manager.cc:1428] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260806 18:39:05.992105 14168 heartbeater.cc:503] Master 127.12.177.190:42331 was elected leader, sending a full tablet report...
W20260806 18:39:06.120862 14171 tablet.cc:2369] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:06.134647 14374 tablet.cc:2369] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:06.147176 14571 tablet.cc:2369] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:06.148563 14605 raft_consensus.cc:482] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:06.148902 14605 raft_consensus.cc:504] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:06.150472 14605 leader_election.cc:288] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c5ed05378e4dccb7380f818179e4e8 (127.12.177.130:35867), cfbcafad1eda4794b21fc20e369d3b45 (127.12.177.131:34765)
I20260806 18:39:06.156060 14608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.150808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:35867 (local address 127.12.177.129:44099)
0806 18:39:06.151533 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:06.151548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:06.151715 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:06.152236 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:06.152238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:06.152254 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:06.152556 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:06.152564 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.153419 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.153424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:06.154523 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:06.154533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.155291 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.155295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:06.155457 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.155489 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 18:39:06.155680 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 18:39:06.155770 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":22,"thread_start_us":387,"threads_started":1}
I20260806 18:39:06.156071 14588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.150970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:44099 (local address 127.12.177.130:35867)
0806 18:39:06.151122 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:06.151127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:06.151709 (+ 582us) server_negotiation.cc:407] Connection header received
0806 18:39:06.151907 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:06.151911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:06.151964 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:06.152272 (+ 308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:06.152720 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.153284 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.154672 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.155150 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.155250 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.155294 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:06.155706 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 18:39:06.155827 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:06.156387 14590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.150920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:40131 (local address 127.12.177.131:34765)
0806 18:39:06.151122 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:06.151127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:06.151824 (+ 697us) server_negotiation.cc:407] Connection header received
0806 18:39:06.151910 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:06.151913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:06.151966 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:06.152024 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:06.152644 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.153309 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.154835 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.155502 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.155723 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.155772 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:06.156151 (+ 379us) server_negotiation.cc:299] Negotiation successful
0806 18:39:06.156262 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 18:39:06.156411 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.150847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:34765 (local address 127.12.177.129:40131)
0806 18:39:06.151615 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:06.151654 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:06.151812 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:06.152134 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:06.152139 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:06.152166 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:06.152482 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:06.152513 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.153483 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.153491 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:06.154683 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:06.154694 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.155708 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.155712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:06.155983 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.156011 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 18:39:06.156104 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 18:39:06.156191 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":19,"thread_start_us":293,"threads_started":1}
I20260806 18:39:06.157246 14304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa74d223cca4f67987588148df276e6" candidate_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c5ed05378e4dccb7380f818179e4e8" is_pre_election: true
I20260806 18:39:06.157487 14494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa74d223cca4f67987588148df276e6" candidate_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbcafad1eda4794b21fc20e369d3b45" is_pre_election: true
I20260806 18:39:06.157667 14304 raft_consensus.cc:2454] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458df8f2127b4e439b8cf9579f9b2ec2 in term 0.
I20260806 18:39:06.157811 14494 raft_consensus.cc:2454] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458df8f2127b4e439b8cf9579f9b2ec2 in term 0.
I20260806 18:39:06.158354 13983 leader_election.cc:302] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458df8f2127b4e439b8cf9579f9b2ec2, e4c5ed05378e4dccb7380f818179e4e8; no voters:
I20260806 18:39:06.158686 14605 raft_consensus.cc:2781] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:06.158785 14605 raft_consensus.cc:482] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:06.158833 14605 raft_consensus.cc:3037] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:06.160243 14605 raft_consensus.cc:504] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:06.160635 14605 leader_election.cc:288] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [CANDIDATE]: Term 1 election: Requested vote from peers e4c5ed05378e4dccb7380f818179e4e8 (127.12.177.130:35867), cfbcafad1eda4794b21fc20e369d3b45 (127.12.177.131:34765)
I20260806 18:39:06.161245 14304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa74d223cca4f67987588148df276e6" candidate_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c5ed05378e4dccb7380f818179e4e8"
I20260806 18:39:06.161247 14494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa74d223cca4f67987588148df276e6" candidate_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbcafad1eda4794b21fc20e369d3b45"
I20260806 18:39:06.161437 14494 raft_consensus.cc:3037] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:06.161437 14304 raft_consensus.cc:3037] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:06.163208 14494 raft_consensus.cc:2454] T 7fa74d223cca4f67987588148df276e6 P cfbcafad1eda4794b21fc20e369d3b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458df8f2127b4e439b8cf9579f9b2ec2 in term 1.
I20260806 18:39:06.163210 14304 raft_consensus.cc:2454] T 7fa74d223cca4f67987588148df276e6 P e4c5ed05378e4dccb7380f818179e4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458df8f2127b4e439b8cf9579f9b2ec2 in term 1.
I20260806 18:39:06.163719 13983 leader_election.cc:302] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458df8f2127b4e439b8cf9579f9b2ec2, e4c5ed05378e4dccb7380f818179e4e8; no voters:
I20260806 18:39:06.163949 14605 raft_consensus.cc:2781] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:06.164362 14605 raft_consensus.cc:686] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [term 1 LEADER]: Becoming Leader. State: Replica: 458df8f2127b4e439b8cf9579f9b2ec2, State: Running, Role: LEADER
I20260806 18:39:06.164800 14605 consensus_queue.cc:237] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } }
I20260806 18:39:06.169821 13861 catalog_manager.cc:5495] T 7fa74d223cca4f67987588148df276e6 P 458df8f2127b4e439b8cf9579f9b2ec2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458df8f2127b4e439b8cf9579f9b2ec2 (127.12.177.129). New cstate: current_term: 1 leader_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458df8f2127b4e439b8cf9579f9b2ec2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c5ed05378e4dccb7380f818179e4e8" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfbcafad1eda4794b21fc20e369d3b45" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 34765 } health_report { overall_health: UNKNOWN } } }
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:06.202167 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.190727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.12.177.129:38429)
0806 18:39:06.190942 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:06.190950 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:06.191303 (+ 353us) server_negotiation.cc:407] Connection header received
0806 18:39:06.191483 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:06.191487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:06.191546 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:06.191642 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:06.192572 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.193108 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.194345 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.194585 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.194699 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.197875 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:06.197890 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:06.197908 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:06.197941 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:06.200267 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.200750 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.200757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.200758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.200882 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.201167 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.201169 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.201170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.201502 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:06.201736 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:06.201863 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 18:39:06.201975 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:06.237757 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.227407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.12.177.129:38429)
0806 18:39:06.227544 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:06.227548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:06.227566 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:39:06.227611 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:06.227614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:06.227656 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:06.227730 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:06.228533 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.229082 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.230089 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.230436 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.230537 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.233703 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:06.233714 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:06.233716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:06.233750 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:06.235453 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.235962 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.235968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.235974 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.236267 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.236637 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.236640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.236642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.236861 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:06.237096 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:06.237423 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 18:39:06.237571 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[13803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[13803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:06.273461 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:06.263253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.12.177.129:38429)
0806 18:39:06.263448 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:06.263451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:06.263469 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:39:06.263708 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:06.263711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:06.263760 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:06.263842 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:06.264629 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.265159 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.266232 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:06.266544 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:06.266695 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:06.269754 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:06.269757 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:06.269759 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:06.269792 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:06.271340 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.271822 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.271825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.271826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.271992 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:06.272382 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:06.272386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:06.272387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:06.272597 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:06.272742 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:06.273058 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 18:39:06.273218 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
W20260806 18:39:06.275038 14030 tablet_service.cc:2908] Rejecting scan request for tablet 7fa74d223cca4f67987588148df276e6: Uninitialized: clean time has not yet been initialized
I20260806 18:39:06.277858 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13957
I20260806 18:39:06.298182 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14176
I20260806 18:39:06.313598 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14379
I20260806 18:39:06.324039 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13824
2026-08-06T18:39:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2939 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[14626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[14626](info): set up 2 sockets
Aug 06 18:39:06 dist-test-slave-j2vl krb5kdc[14626](info): commencing operation
krb5kdc: starting...
W20260806 18:39:07.617313 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:07 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:07.765676 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:43361
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:43361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:07.891695 14646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:07.892073 14646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:07.892163 14646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:07.896449 14646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:07.896574 14646 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 18:39:07.896605 14646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:07.896649 14646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:07.896687 14646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:07.896718 14646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:07.902609 14646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:43361
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:43361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:07.903954 14646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:07.905143 14646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:07.914867 14655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:07.914971 14661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:07.915215 14658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:07.915433 14646 server_base.cc:1034] running on GCE node
I20260806 18:39:07.916345 14646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:07.917852 14646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:07.919080 14646 hybrid_clock.cc:648] HybridClock initialized: now 1786041547919034 us; error 61 us; skew 500 ppm
Aug 06 18:39:07 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041547, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:07.923035 14646 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:07.924533 14646 webserver.cc:460] Webserver started at http://127.12.177.190:37121/ using document root <none> and password file <none>
I20260806 18:39:07.925244 14646 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:07.925355 14646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:07.925662 14646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:07.928654 14646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7"
format_stamp: "Formatted at 2026-08-06 18:39:07 on dist-test-slave-j2vl"
server_key: "a3ffe7b55e48c21c7ce0b80c61d71200"
server_key_iv: "d9ffaa61e99106e72344e75e07e02983"
server_key_version: "encryptionkey@0"
I20260806 18:39:07.929453 14646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7"
format_stamp: "Formatted at 2026-08-06 18:39:07 on dist-test-slave-j2vl"
server_key: "a3ffe7b55e48c21c7ce0b80c61d71200"
server_key_iv: "d9ffaa61e99106e72344e75e07e02983"
server_key_version: "encryptionkey@0"
I20260806 18:39:07.934237 14646 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:39:07.937532 14672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:07.939358 14646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:39:07.939566 14646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7"
format_stamp: "Formatted at 2026-08-06 18:39:07 on dist-test-slave-j2vl"
server_key: "a3ffe7b55e48c21c7ce0b80c61d71200"
server_key_iv: "d9ffaa61e99106e72344e75e07e02983"
server_key_version: "encryptionkey@0"
I20260806 18:39:07.939724 14646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:07.952996 14646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:07.957147 14646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:07.957465 14646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:07.967368 14646 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:43361
I20260806 18:39:07.967639 14759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:43361 every 8 connection(s)
I20260806 18:39:07.968926 14646 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:07.972424 14761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:07.974704 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14646
I20260806 18:39:07.974893 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:07.975186 12998 external_mini_cluster.cc:1428] Setting key 89d5cd9f7462e83656ca92264bfd382a
I20260806 18:39:07.980831 14761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Bootstrap starting.
I20260806 18:39:07.984200 14761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:07.985077 14761 log.cc:824] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:39:07 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:07.988543 14761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: No bootstrap required, opened a new log
I20260806 18:39:07.993229 14761 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } }
I20260806 18:39:07.993608 14761 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:07.993669 14761 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9ec9a20abc4c1793d53bdaa60f79a7, State: Initialized, Role: FOLLOWER
I20260806 18:39:07.994120 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:07.977217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52094 (local address 127.12.177.190:43361)
0806 18:39:07.977795 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:07.977815 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:07.977857 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:39:07.978586 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:07.978606 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:07.978989 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:07.979309 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:07.980405 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:07.981637 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:07.982937 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:07.983501 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:07.983645 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:07.986767 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:07.986774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:07.986796 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:07.986831 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:07.990141 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:07.990746 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:07.990753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:07.990761 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:07.990925 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:07.991295 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:07.991299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:07.991301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:07.991899 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:07.992124 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:07.992491 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 18:39:07.992851 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":196,"threads_started":1}
I20260806 18:39:07.994210 14761 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } }
I20260806 18:39:07.994385 14761 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:07.994449 14761 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:07.994551 14761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:07.995698 14761 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } }
I20260806 18:39:07.996266 14761 leader_election.cc:302] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea9ec9a20abc4c1793d53bdaa60f79a7; no voters:
I20260806 18:39:07.996750 14761 leader_election.cc:288] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:07.996906 14769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:07.997185 14769 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [term 1 LEADER]: Becoming Leader. State: Replica: ea9ec9a20abc4c1793d53bdaa60f79a7, State: Running, Role: LEADER
I20260806 18:39:07.997578 14769 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } }
I20260806 18:39:07.998962 14769 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea9ec9a20abc4c1793d53bdaa60f79a7. Latest consensus state: current_term: 1 leader_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } } }
I20260806 18:39:07.999128 14769 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:07.999289 14761 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:07.999490 14774 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9ec9a20abc4c1793d53bdaa60f79a7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43361 } } }
I20260806 18:39:07.999576 14774 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:08.000077 14777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:08.003743 14777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:08.011636 14777 catalog_manager.cc:1347] Generated new cluster ID: ad566b36dc7c40bcaf1a44be60f6f1f5
I20260806 18:39:08.011776 14777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:08.036932 14777 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:08.038625 14777 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:08.052006 14777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Generated new TSK 0
I20260806 18:39:08.052937 14777 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:08.093587 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:43361
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:08.226143 14803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:08.226524 14803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:08.226613 14803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:08.230988 14803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:08.231102 14803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:08.231179 14803 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:08.231269 14803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:08.237335 14803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:43361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:08.238754 14803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:08.239935 14803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:08.251085 14803 server_base.cc:1034] running on GCE node
W20260806 18:39:08.251034 14810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.251269 14812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.251017 14808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:08.251824 14803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:08.252543 14803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:08.253759 14803 hybrid_clock.cc:648] HybridClock initialized: now 1786041548253737 us; error 34 us; skew 500 ppm
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:08.256942 14803 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:08.258054 14803 webserver.cc:460] Webserver started at http://127.12.177.129:44471/ using document root <none> and password file <none>
I20260806 18:39:08.258658 14803 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:08.258754 14803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:08.259011 14803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:08.261152 14803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "7e0dd5c3720c42558202ffb3a31167ab"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "ee4cc4116c3d54ac82d23b727995ab7d"
server_key_iv: "1c95228efb71be9b9cc2c1578339226a"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.261814 14803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "7e0dd5c3720c42558202ffb3a31167ab"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "ee4cc4116c3d54ac82d23b727995ab7d"
server_key_iv: "1c95228efb71be9b9cc2c1578339226a"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.266029 14803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:08.268900 14823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.270560 14803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:08.270748 14803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "7e0dd5c3720c42558202ffb3a31167ab"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "ee4cc4116c3d54ac82d23b727995ab7d"
server_key_iv: "1c95228efb71be9b9cc2c1578339226a"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.270895 14803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:08.286001 14803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:08.289681 14803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:08.289953 14803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:08.291743 14803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:08.291831 14803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.291924 14803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:08.292001 14803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:08.304039 14803 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:33831
I20260806 18:39:08.304119 15019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:33831 every 8 connection(s)
I20260806 18:39:08.305174 14803 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:08.307770 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.292763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42567 (local address 127.12.177.190:43361)
0806 18:39:08.292909 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.292913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.294150 (+ 1237us) server_negotiation.cc:407] Connection header received
0806 18:39:08.295370 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.295373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.295438 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.295550 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.297142 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.297920 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.300083 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.300447 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.300581 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.303654 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.303658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.303664 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.303700 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.305484 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.306123 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.306127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.306129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.306223 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.306595 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.306599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.306600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.306803 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.306913 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.307423 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.307578 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:08.308598 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.293389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.129:42567)
0806 18:39:08.293977 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.294027 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.295059 (+ 1032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.295755 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.295783 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.296281 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.296961 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.296985 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.298107 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.298114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.299935 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.299952 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.300652 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.300656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.300926 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.301729 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.301752 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.303450 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.305610 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.305616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.305631 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.306018 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.306329 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.306332 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.306335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.306491 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.306914 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.306921 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.307182 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.307381 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.307723 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":141,"threads_started":1}
I20260806 18:39:08.310098 15020 heartbeater.cc:347] Connected to a master server at 127.12.177.190:43361
I20260806 18:39:08.310365 15020 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:08.310945 15020 heartbeater.cc:511] Master 127.12.177.190:43361 requested a full tablet report, sending...
I20260806 18:39:08.312700 14690 ts_manager.cc:194] Registered new tserver with Master: 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831)
I20260806 18:39:08.313087 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14803
I20260806 18:39:08.313201 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:08.313545 12998 external_mini_cluster.cc:1428] Setting key c466ee3b46177e86a8f8115853bf8157
I20260806 18:39:08.314429 14690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:42567
I20260806 18:39:08.322024 15034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.312699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.129:47955)
0806 18:39:08.313090 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.313106 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.313217 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.313541 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.313544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.313786 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.313925 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.313932 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.315246 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.315250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.316198 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.316214 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.317062 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.317068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.317200 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.317951 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.317964 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.318344 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.320208 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.320212 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.320214 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.320449 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.320787 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.320791 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.320796 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.320914 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.321367 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.321372 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.321505 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.321627 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.321810 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":128,"threads_started":1}
I20260806 18:39:08.322019 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.312775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:47955 (local address 127.12.177.190:43361)
0806 18:39:08.312912 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.312916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.313198 (+ 282us) server_negotiation.cc:407] Connection header received
0806 18:39:08.313323 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.313326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.313407 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.313498 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.314116 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.315068 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.316381 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.316771 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.316864 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.318506 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.318511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.318519 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.318542 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.320052 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.320585 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.320588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.320592 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.320682 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.321005 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.321008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.321010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.321229 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.321351 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.321686 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.321817 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":320,"server-negotiator.queue_time_us":58}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:08.354030 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:43361
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:08.489303 15037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:08.489727 15037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:08.489811 15037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:08.495329 15037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:08.495433 15037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:08.495479 15037 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:08.495549 15037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:08.502197 15037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:43361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:08.503526 15037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:08.504696 15037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:08.516637 15044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.516637 15043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.516754 15046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:08.517215 15037 server_base.cc:1034] running on GCE node
I20260806 18:39:08.517793 15037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:08.518637 15037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:08.519917 15037 hybrid_clock.cc:648] HybridClock initialized: now 1786041548519900 us; error 32 us; skew 500 ppm
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:08.523702 15037 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:08.524919 15037 webserver.cc:460] Webserver started at http://127.12.177.130:45085/ using document root <none> and password file <none>
I20260806 18:39:08.525779 15037 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:08.525903 15037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:08.526170 15037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:08.528597 15037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "d4aa29885173436895590ddf89c184ac"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "c00eb66a8d97a8b45ac5f7de9ae3c7f9"
server_key_iv: "844cb7ecb05c7532f8ca20e8e2a37a8e"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.529644 15037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "d4aa29885173436895590ddf89c184ac"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "c00eb66a8d97a8b45ac5f7de9ae3c7f9"
server_key_iv: "844cb7ecb05c7532f8ca20e8e2a37a8e"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.534319 15037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:39:08.537559 15054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.539170 15037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:39:08.539361 15037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "d4aa29885173436895590ddf89c184ac"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "c00eb66a8d97a8b45ac5f7de9ae3c7f9"
server_key_iv: "844cb7ecb05c7532f8ca20e8e2a37a8e"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.539516 15037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:08.576758 15037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:08.581156 15037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:08.581427 15037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:08.583128 15037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:08.583221 15037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.583295 15037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:08.583343 15037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:08.596609 15037 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:42377
I20260806 18:39:08.596935 15240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:42377 every 8 connection(s)
I20260806 18:39:08.597929 15037 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:08.599995 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.584420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:36697 (local address 127.12.177.190:43361)
0806 18:39:08.584691 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.584697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.585648 (+ 951us) server_negotiation.cc:407] Connection header received
0806 18:39:08.586642 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.586648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.586718 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.586785 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.588843 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.589817 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.591375 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.591638 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.591768 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.595461 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.595465 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.595468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.595595 (+ 127us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.597540 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.598215 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.598220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.598223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.598339 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.598775 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.598779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.598780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.599029 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.599152 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.599671 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.599822 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260806 18:39:08.600973 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.584833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.130:36697)
0806 18:39:08.585436 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.585492 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.586372 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.587285 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.587297 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.587929 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.588627 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.588653 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.590043 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.590047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.591216 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.591227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.591856 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.591862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.592104 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.592829 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.592852 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.595181 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.597708 (+ 2527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.597714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.597727 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.598116 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.598459 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.598462 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.598466 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.598647 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.599149 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.599157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.599418 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.599623 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.600024 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":153,"threads_started":1}
I20260806 18:39:08.602295 15241 heartbeater.cc:347] Connected to a master server at 127.12.177.190:43361
I20260806 18:39:08.602478 15241 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:08.603045 15241 heartbeater.cc:511] Master 127.12.177.190:43361 requested a full tablet report, sending...
I20260806 18:39:08.604295 14695 ts_manager.cc:194] Registered new tserver with Master: d4aa29885173436895590ddf89c184ac (127.12.177.130:42377)
I20260806 18:39:08.605119 14695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:36697
I20260806 18:39:08.605654 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15037
I20260806 18:39:08.605773 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:08.606105 12998 external_mini_cluster.cc:1428] Setting key ea249c40a7bd829e70efddf4b0c9edd3
I20260806 18:39:08.613710 15249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.604873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.130:38647)
0806 18:39:08.605211 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.605230 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.605416 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.605847 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.605851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.606099 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.606250 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.606260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.607306 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.607309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.607967 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.607978 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.608638 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.608641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.608718 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.609450 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.609465 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.609936 (+ 471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.611935 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.611938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.611940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.612173 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.612496 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.612499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.612501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.612595 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.613060 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.613063 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.613176 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.613294 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.613511 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":143,"threads_started":1}
I20260806 18:39:08.613703 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.604933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:38647 (local address 127.12.177.190:43361)
0806 18:39:08.605075 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.605080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.605298 (+ 218us) server_negotiation.cc:407] Connection header received
0806 18:39:08.605560 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.605563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.605617 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.605678 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.606400 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.607135 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.608099 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.608509 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.608638 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.610121 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.610125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.610128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.610157 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.611799 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.612288 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.612291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.612293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.612387 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.612692 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.612696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.612698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.612952 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.613069 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.613396 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.613525 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:08.641508 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:43361
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:08.769743 15257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:08.770299 15257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:08.770462 15257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:08.775017 15257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:08.775106 15257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:08.775151 15257 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:08.775219 15257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:08.781687 15257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:43361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:08.782987 15257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:08.784138 15257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:08.794793 15263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.794791 15267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:08.794791 15264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:08.795392 15257 server_base.cc:1034] running on GCE node
I20260806 18:39:08.795869 15257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:08.796615 15257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:08.797819 15257 hybrid_clock.cc:648] HybridClock initialized: now 1786041548797787 us; error 45 us; skew 500 ppm
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:08.801218 15257 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:08.802424 15257 webserver.cc:460] Webserver started at http://127.12.177.131:39883/ using document root <none> and password file <none>
I20260806 18:39:08.803148 15257 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:08.803251 15257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:08.803514 15257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:08.805972 15257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "8f57f36297594fffa7635f7e3a205663"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "a16c60a0a4041b3b37c847c407e1fec0"
server_key_iv: "8f4219456f3763e731a394941fde6d91"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.806627 15257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "8f57f36297594fffa7635f7e3a205663"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "a16c60a0a4041b3b37c847c407e1fec0"
server_key_iv: "8f4219456f3763e731a394941fde6d91"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.811144 15257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:08.814129 15274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.815868 15257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:08.816004 15257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "8f57f36297594fffa7635f7e3a205663"
format_stamp: "Formatted at 2026-08-06 18:39:08 on dist-test-slave-j2vl"
server_key: "a16c60a0a4041b3b37c847c407e1fec0"
server_key_iv: "8f4219456f3763e731a394941fde6d91"
server_key_version: "encryptionkey@0"
I20260806 18:39:08.816195 15257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:08.827334 15257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:08.831292 15257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:08.831553 15257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:08.833240 15257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:08.833299 15257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:08.833400 15257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:08.833434 15257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:08.846426 15257 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:38023
I20260806 18:39:08.846475 15461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:38023 every 8 connection(s)
I20260806 18:39:08.847816 15257 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:08.851130 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15257
I20260806 18:39:08.851281 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:08.851568 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.834368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:49605 (local address 127.12.177.190:43361)
0806 18:39:08.834547 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.834553 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.835554 (+ 1001us) server_negotiation.cc:407] Connection header received
0806 18:39:08.836986 (+ 1432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.836992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.837075 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.837188 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.839123 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.840177 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.841861 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.842230 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.842373 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.846173 (+ 3800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.846180 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.846186 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.846227 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.848064 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.849257 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.849261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.849263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.849459 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.850090 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.850094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.850095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.850346 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.850446 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.851212 (+ 766us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.851377 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:39:08.851593 12998 external_mini_cluster.cc:1428] Setting key 8b464a8a8e2e31111de26dee2dcbd4ea
I20260806 18:39:08.852716 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.834838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.131:49605)
0806 18:39:08.835373 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.835431 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.836667 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.837475 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.837483 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.837996 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.838855 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.838883 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.840394 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.840398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.841708 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.841722 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.842432 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.842436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.842629 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.843414 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.843434 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.845876 (+ 2442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.848406 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.848415 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.848434 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.848976 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.849622 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.849625 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.849627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.849916 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.850517 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.850524 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.850837 (+ 313us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.851084 (+ 247us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.851500 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":153,"threads_started":1}
I20260806 18:39:08.854334 15462 heartbeater.cc:347] Connected to a master server at 127.12.177.190:43361
I20260806 18:39:08.854523 15462 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:08.855245 15462 heartbeater.cc:511] Master 127.12.177.190:43361 requested a full tablet report, sending...
I20260806 18:39:08.856901 14690 ts_manager.cc:194] Registered new tserver with Master: 8f57f36297594fffa7635f7e3a205663 (127.12.177.131:38023)
I20260806 18:39:08.857823 14690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:49605
I20260806 18:39:08.866619 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.856858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:52017 (local address 127.12.177.190:43361)
0806 18:39:08.857175 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.857181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.857414 (+ 233us) server_negotiation.cc:407] Connection header received
0806 18:39:08.857525 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.857528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.857579 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.857686 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.858488 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.859142 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.860359 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.860599 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.860697 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.862111 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.862114 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.862116 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.862141 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.863745 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.864305 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.864310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.864312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.864417 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.865054 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.865057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.865058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.865281 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.865464 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.865941 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.866277 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260806 18:39:08.866674 15471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.856714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.12.177.131:52017)
0806 18:39:08.857257 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.857273 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.857434 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.857704 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.857707 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.858162 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:08.858347 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.858357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.859284 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.859287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.860174 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.860186 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.860750 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.860753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.860856 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.861537 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:08.861550 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:08.861931 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:08.863890 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.863893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.863895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.864151 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.864552 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:08.864555 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:08.864557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:08.864666 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:08.865462 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:08.865466 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:08.865600 (+ 134us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.865868 (+ 268us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.866277 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":40,"thread_start_us":130,"threads_started":1}
I20260806 18:39:08.867031 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 18:39:08 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:08.903857 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.891616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52098 (local address 127.12.177.190:43361)
0806 18:39:08.891787 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.891791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.891804 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:39:08.891850 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.891852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.891895 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.892077 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:08.893228 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.893914 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.894886 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.895150 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.895259 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.898725 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:08.898729 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:08.898732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:08.898776 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:08.900580 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.901431 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.901435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.901436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.901544 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:08.902126 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:08.902135 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:08.902136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:08.902367 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:08.903099 (+ 732us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.903336 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.903580 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 18:39:08.908033 14690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:08.911628 14690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:08.928565 15489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.922114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:42377 (local address 127.0.0.1:54420)
0806 18:39:08.922663 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.922717 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.922858 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.923991 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.923999 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.924024 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:08.924178 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.924185 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925750 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.925754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.927056 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.927067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.927952 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.927958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.928073 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.928112 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.928236 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.928377 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":42,"thread_start_us":104,"threads_started":1}
I20260806 18:39:08.928580 15490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.922327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:33831 (local address 127.0.0.1:48804)
0806 18:39:08.923256 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.923270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.923389 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.924150 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.924152 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.924168 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:08.924299 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.924305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925782 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.925786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.927065 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.927075 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.928225 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.928231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.928323 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.928342 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.928427 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.928488 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":297,"thread_start_us":118,"threads_started":1}
I20260806 18:39:08.928846 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.922894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48804 (local address 127.12.177.129:33831)
0806 18:39:08.923274 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.923284 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.923493 (+ 209us) server_negotiation.cc:407] Connection header received
0806 18:39:08.923588 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.923593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.923815 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.923982 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:08.924441 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925601 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.927222 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.928049 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.928177 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.928313 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.928561 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.928696 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":84,"threads_started":1}
I20260806 18:39:08.928979 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.922331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.12.177.130:42377)
0806 18:39:08.923508 (+ 1177us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.923521 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.923541 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:39:08.923602 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.923607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.923814 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.923982 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:08.924317 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925604 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.927193 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.927809 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.927981 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.928141 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.928666 (+ 525us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.928786 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1065,"thread_start_us":138,"threads_started":1}
I20260806 18:39:08.930809 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.922879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:38023 (local address 127.0.0.1:41972)
0806 18:39:08.923594 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.923607 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.923693 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.924365 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.924368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.924385 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:08.924472 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.924479 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925498 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.925501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.928033 (+ 2532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.928045 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.930349 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.930353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.930454 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.930486 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.930545 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.930647 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":109,"thread_start_us":106,"threads_started":1}
I20260806 18:39:08.931571 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.923209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.12.177.131:38023)
0806 18:39:08.923932 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.923944 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.923966 (+ 22us) server_negotiation.cc:407] Connection header received
0806 18:39:08.924038 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.924043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.924223 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.924389 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:08.924570 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.925332 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.928197 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.930190 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.931192 (+ 1002us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.931312 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.931360 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.931446 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":122,"threads_started":1}
I20260806 18:39:08.932507 15138 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 (DEFAULT_TABLE table=test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:08.932490 14912 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 (DEFAULT_TABLE table=test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:08.933828 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5e95080f394367b7648cb3d3aa8225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:08.933828 15138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5e95080f394367b7648cb3d3aa8225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:08.934208 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 (DEFAULT_TABLE table=test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:08.935575 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5e95080f394367b7648cb3d3aa8225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:08.943138 15499 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Bootstrap starting.
I20260806 18:39:08.943805 15500 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Bootstrap starting.
I20260806 18:39:08.944600 15504 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Bootstrap starting.
I20260806 18:39:08.946493 15499 tablet_bootstrap.cc:654] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:08.946589 15500 tablet_bootstrap.cc:654] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:08.947258 15504 tablet_bootstrap.cc:654] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:08.947700 15500 log.cc:824] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:08.947702 15499 log.cc:824] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:08.948256 15504 log.cc:824] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:08.950165 15499 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: No bootstrap required, opened a new log
I20260806 18:39:08.950430 15499 ts_tablet_manager.cc:1397] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 18:39:08.950477 15504 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: No bootstrap required, opened a new log
I20260806 18:39:08.950680 15500 tablet_bootstrap.cc:492] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: No bootstrap required, opened a new log
I20260806 18:39:08.950677 15504 ts_tablet_manager.cc:1397] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:39:08.950863 15500 ts_tablet_manager.cc:1397] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 18:39:08.955003 15499 raft_consensus.cc:348] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.955372 15499 raft_consensus.cc:374] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:08.955446 15499 raft_consensus.cc:729] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0dd5c3720c42558202ffb3a31167ab, State: Initialized, Role: FOLLOWER
I20260806 18:39:08.955979 15499 consensus_queue.cc:260] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.956040 15500 raft_consensus.cc:348] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.956211 15504 raft_consensus.cc:348] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.956377 15500 raft_consensus.cc:374] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:08.956457 15504 raft_consensus.cc:374] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:08.956456 15500 raft_consensus.cc:729] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4aa29885173436895590ddf89c184ac, State: Initialized, Role: FOLLOWER
I20260806 18:39:08.956514 15504 raft_consensus.cc:729] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f57f36297594fffa7635f7e3a205663, State: Initialized, Role: FOLLOWER
I20260806 18:39:08.956959 15020 heartbeater.cc:503] Master 127.12.177.190:43361 was elected leader, sending a full tablet report...
I20260806 18:39:08.956995 15500 consensus_queue.cc:260] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.956996 15504 consensus_queue.cc:260] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.957818 15499 ts_tablet_manager.cc:1428] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:39:08.958202 15504 ts_tablet_manager.cc:1428] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260806 18:39:08.958202 15500 ts_tablet_manager.cc:1428] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260806 18:39:08.958590 15462 heartbeater.cc:503] Master 127.12.177.190:43361 was elected leader, sending a full tablet report...
I20260806 18:39:08.959803 15241 heartbeater.cc:503] Master 127.12.177.190:43361 was elected leader, sending a full tablet report...
I20260806 18:39:08.980695 15510 raft_consensus.cc:482] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:08.980999 15510 raft_consensus.cc:504] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.982779 15510 leader_election.cc:288] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4aa29885173436895590ddf89c184ac (127.12.177.130:42377), 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831)
I20260806 18:39:08.988700 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.983232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:33831 (local address 127.12.177.131:59673)
0806 18:39:08.983808 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.983819 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.983932 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.984173 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.984177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.984258 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:08.984396 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.984405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.985560 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.985564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.987139 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.987153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.988118 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.988122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.988226 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.988249 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.988380 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.988466 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":151,"thread_start_us":274,"threads_started":1}
I20260806 18:39:08.988664 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.983455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59673 (local address 127.12.177.129:33831)
0806 18:39:08.983620 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.983626 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.983946 (+ 320us) server_negotiation.cc:407] Connection header received
0806 18:39:08.984012 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.984016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.984068 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.984128 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:08.984542 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.985400 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.987316 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.987948 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.988097 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.988179 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.988406 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.988540 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 18:39:08.988981 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.983385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59393 (local address 127.12.177.130:42377)
0806 18:39:08.983627 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:08.983634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:08.983657 (+ 23us) server_negotiation.cc:407] Connection header received
0806 18:39:08.983721 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:08.983724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:08.983782 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:08.983877 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:08.984526 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.985400 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.987617 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.988245 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.988404 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.988452 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:08.988744 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 18:39:08.988855 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:39:08.989041 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:08.983226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:42377 (local address 127.12.177.131:59393)
0806 18:39:08.983408 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:08.983427 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:08.983549 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:08.983920 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:08.983923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:08.983937 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:08.984320 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.984329 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.985560 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.985564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.987472 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:08.987480 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:08.988396 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:08.988399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:08.988596 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:08.988618 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:39:08.988704 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 18:39:08.988798 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":41}
I20260806 18:39:08.990156 14940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5e95080f394367b7648cb3d3aa8225" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0dd5c3720c42558202ffb3a31167ab" is_pre_election: true
I20260806 18:39:08.990083 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5e95080f394367b7648cb3d3aa8225" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac" is_pre_election: true
I20260806 18:39:08.990509 14940 raft_consensus.cc:2454] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 0.
I20260806 18:39:08.990509 15165 raft_consensus.cc:2454] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 0.
I20260806 18:39:08.991164 15275 leader_election.cc:302] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7e0dd5c3720c42558202ffb3a31167ab, 8f57f36297594fffa7635f7e3a205663, d4aa29885173436895590ddf89c184ac; no voters:
I20260806 18:39:08.991498 15510 raft_consensus.cc:2781] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:08.991598 15510 raft_consensus.cc:482] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:08.991645 15510 raft_consensus.cc:3037] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:08.992939 15510 raft_consensus.cc:504] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:08.993520 15510 leader_election.cc:288] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 election: Requested vote from peers d4aa29885173436895590ddf89c184ac (127.12.177.130:42377), 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831)
I20260806 18:39:08.994112 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5e95080f394367b7648cb3d3aa8225" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac"
I20260806 18:39:08.994318 15165 raft_consensus.cc:3037] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:08.994315 14940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5e95080f394367b7648cb3d3aa8225" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0dd5c3720c42558202ffb3a31167ab"
I20260806 18:39:08.994457 14940 raft_consensus.cc:3037] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:08.995572 14940 raft_consensus.cc:2454] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 1.
I20260806 18:39:08.996030 15277 leader_election.cc:302] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0dd5c3720c42558202ffb3a31167ab, 8f57f36297594fffa7635f7e3a205663; no voters:
I20260806 18:39:08.996089 15165 raft_consensus.cc:2454] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 1.
I20260806 18:39:08.996254 15510 raft_consensus.cc:2781] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:08.996687 15510 raft_consensus.cc:686] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 1 LEADER]: Becoming Leader. State: Replica: 8f57f36297594fffa7635f7e3a205663, State: Running, Role: LEADER
I20260806 18:39:08.997113 15510 consensus_queue.cc:237] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.001044 14690 catalog_manager.cc:5495] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f57f36297594fffa7635f7e3a205663 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:09.028358 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.023805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41980 (local address 127.12.177.131:38023)
0806 18:39:09.023986 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.023991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.024018 (+ 27us) server_negotiation.cc:407] Connection header received
0806 18:39:09.024212 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.024215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.024282 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.024371 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:09.024669 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.025202 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.026223 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.026492 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.026587 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.027203 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.027703 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.027810 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.028050 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.028162 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 18:39:09.035097 14940 raft_consensus.cc:1261] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Refusing update from remote peer 8f57f36297594fffa7635f7e3a205663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.035097 15165 raft_consensus.cc:1261] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Refusing update from remote peer 8f57f36297594fffa7635f7e3a205663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.035949 15514 consensus_queue.cc:1035] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.036151 15510 consensus_queue.cc:1035] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.045866 15526 mvcc.cc:205] Tried to move back new op lower bound from 7315626184838942720 to 7315626184695242752. Current Snapshot: MvccSnapshot[applied={T|T < 7315626184838942720}]
I20260806 18:39:09.064000 14695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:09.064244 14695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:09.067384 14695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Sending DeleteTablet for 3 replicas of tablet 4c5e95080f394367b7648cb3d3aa8225
I20260806 18:39:09.069123 14912 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:48804
I20260806 18:39:09.069165 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:41972
I20260806 18:39:09.069866 15138 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5e95080f394367b7648cb3d3aa8225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:54420
I20260806 18:39:09.069913 14695 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 18:39:09.070281 15544 tablet_replica.cc:330] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: stopping tablet replica
W20260806 18:39:09.070473 14695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:09.070596 15545 tablet_replica.cc:330] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: stopping tablet replica
I20260806 18:39:09.070919 15544 raft_consensus.cc:2229] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:09.070972 15545 raft_consensus.cc:2229] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:09.071414 15545 raft_consensus.cc:2258] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.071732 15546 tablet_replica.cc:330] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: stopping tablet replica
I20260806 18:39:09.072253 15544 raft_consensus.cc:2258] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.072420 15546 raft_consensus.cc:2229] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:09.072768 15546 raft_consensus.cc:2258] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.074163 15545 ts_tablet_manager.cc:1905] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.074528 15544 ts_tablet_manager.cc:1905] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.077929 15545 ts_tablet_manager.cc:1918] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:09.078065 15545 log.cc:1196] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/4c5e95080f394367b7648cb3d3aa8225
I20260806 18:39:09.078577 15545 ts_tablet_manager.cc:1939] T 4c5e95080f394367b7648cb3d3aa8225 P 7e0dd5c3720c42558202ffb3a31167ab: Deleting consensus metadata
I20260806 18:39:09.079847 15546 ts_tablet_manager.cc:1905] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.080370 14676 catalog_manager.cc:4841] TS 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831): tablet 4c5e95080f394367b7648cb3d3aa8225 (table test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]) successfully deleted
I20260806 18:39:09.081244 15353 tablet_service.cc:1467] Processing CreateTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c (DEFAULT_TABLE table=test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:09.081243 15138 tablet_service.cc:1467] Processing CreateTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c (DEFAULT_TABLE table=test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:09.081591 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be7bf0c6812b43d79a1dbee2fefce60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.081591 15138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be7bf0c6812b43d79a1dbee2fefce60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.085011 15504 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Bootstrap starting.
I20260806 18:39:09.085752 14912 tablet_service.cc:1467] Processing CreateTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c (DEFAULT_TABLE table=test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:09.086179 15544 ts_tablet_manager.cc:1918] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:09.086294 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be7bf0c6812b43d79a1dbee2fefce60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.086403 15544 log.cc:1196] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/4c5e95080f394367b7648cb3d3aa8225
I20260806 18:39:09.086826 15544 ts_tablet_manager.cc:1939] T 4c5e95080f394367b7648cb3d3aa8225 P 8f57f36297594fffa7635f7e3a205663: Deleting consensus metadata
I20260806 18:39:09.086934 15504 tablet_bootstrap.cc:654] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.088712 15546 ts_tablet_manager.cc:1918] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:09.089021 15546 log.cc:1196] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/4c5e95080f394367b7648cb3d3aa8225
I20260806 18:39:09.089956 15546 ts_tablet_manager.cc:1939] T 4c5e95080f394367b7648cb3d3aa8225 P d4aa29885173436895590ddf89c184ac: Deleting consensus metadata
I20260806 18:39:09.090323 15499 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Bootstrap starting.
I20260806 18:39:09.090495 15500 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Bootstrap starting.
I20260806 18:39:09.090942 14676 catalog_manager.cc:4841] TS 8f57f36297594fffa7635f7e3a205663 (127.12.177.131:38023): tablet 4c5e95080f394367b7648cb3d3aa8225 (table test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]) successfully deleted
I20260806 18:39:09.091851 15499 tablet_bootstrap.cc:654] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.091995 15500 tablet_bootstrap.cc:654] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.093884 15504 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: No bootstrap required, opened a new log
I20260806 18:39:09.094053 15504 ts_tablet_manager.cc:1397] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260806 18:39:09.094400 15499 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: No bootstrap required, opened a new log
I20260806 18:39:09.094517 15499 ts_tablet_manager.cc:1397] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 18:39:09.094843 15504 raft_consensus.cc:348] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.094992 15504 raft_consensus.cc:374] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.095036 15504 raft_consensus.cc:729] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f57f36297594fffa7635f7e3a205663, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.095176 15504 consensus_queue.cc:260] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.095603 15504 ts_tablet_manager.cc:1428] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 18:39:09.095676 15499 raft_consensus.cc:348] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.095805 15499 raft_consensus.cc:374] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.095837 15499 raft_consensus.cc:729] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0dd5c3720c42558202ffb3a31167ab, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.095999 15499 consensus_queue.cc:260] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.097304 15499 ts_tablet_manager.cc:1428] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:09.098240 15500 tablet_bootstrap.cc:492] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: No bootstrap required, opened a new log
I20260806 18:39:09.098690 14674 catalog_manager.cc:4841] TS d4aa29885173436895590ddf89c184ac (127.12.177.130:42377): tablet 4c5e95080f394367b7648cb3d3aa8225 (table test-table [id=33da1b0a49cc4011ba58e71e137f5a1b]) successfully deleted
W20260806 18:39:09.099570 15464 tablet.cc:2369] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:09.100397 15500 ts_tablet_manager.cc:1397] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260806 18:39:09.101610 15500 raft_consensus.cc:348] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.101770 15500 raft_consensus.cc:374] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.101817 15500 raft_consensus.cc:729] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4aa29885173436895590ddf89c184ac, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.101974 15500 consensus_queue.cc:260] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.102720 15500 ts_tablet_manager.cc:1428] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:09.291924 15509 raft_consensus.cc:482] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:09.292140 15509 raft_consensus.cc:504] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.293318 15509 leader_election.cc:288] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4aa29885173436895590ddf89c184ac (127.12.177.130:42377), 8f57f36297594fffa7635f7e3a205663 (127.12.177.131:38023)
I20260806 18:39:09.297459 15552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.293730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:42377 (local address 127.12.177.129:57275)
0806 18:39:09.294031 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.294053 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.294199 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.294523 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.294526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.294543 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:09.294690 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.294696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.295439 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.295444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.296260 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.296270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.296944 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.296948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.297068 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.297088 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.297180 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.297259 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260806 18:39:09.297434 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.293831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:57275 (local address 127.12.177.130:42377)
0806 18:39:09.294066 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.294074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.294157 (+ 83us) server_negotiation.cc:407] Connection header received
0806 18:39:09.294375 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.294378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.294418 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.294509 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:09.294818 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.295325 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.296395 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.296791 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.296928 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.296994 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.297199 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.297272 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260806 18:39:09.297904 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.293794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:44671 (local address 127.12.177.131:38023)
0806 18:39:09.293940 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.293945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.294288 (+ 343us) server_negotiation.cc:407] Connection header received
0806 18:39:09.294465 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.294468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.294513 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.294611 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:09.295053 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.295537 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.296800 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.297220 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.297380 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.297433 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.297717 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.297816 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:39:09.297966 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.293730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:38023 (local address 127.12.177.129:44671)
0806 18:39:09.294182 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.294195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.294322 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.294625 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.294636 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.294657 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:09.294925 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.294931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.295659 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.295663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.296661 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.296671 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.297377 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.297381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.297560 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.297594 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.297687 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.297750 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":55,"thread_start_us":114,"threads_started":1}
I20260806 18:39:09.298359 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be7bf0c6812b43d79a1dbee2fefce60c" candidate_uuid: "7e0dd5c3720c42558202ffb3a31167ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac" is_pre_election: true
I20260806 18:39:09.298553 15165 raft_consensus.cc:2454] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0dd5c3720c42558202ffb3a31167ab in term 0.
I20260806 18:39:09.298622 15385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be7bf0c6812b43d79a1dbee2fefce60c" candidate_uuid: "7e0dd5c3720c42558202ffb3a31167ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f57f36297594fffa7635f7e3a205663" is_pre_election: true
I20260806 18:39:09.298902 15385 raft_consensus.cc:2454] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0dd5c3720c42558202ffb3a31167ab in term 0.
I20260806 18:39:09.298985 14825 leader_election.cc:302] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0dd5c3720c42558202ffb3a31167ab, d4aa29885173436895590ddf89c184ac; no voters:
I20260806 18:39:09.299350 15509 raft_consensus.cc:2781] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:09.299424 15509 raft_consensus.cc:482] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:09.299463 15509 raft_consensus.cc:3037] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.301036 15509 raft_consensus.cc:504] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.301519 15509 leader_election.cc:288] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [CANDIDATE]: Term 1 election: Requested vote from peers d4aa29885173436895590ddf89c184ac (127.12.177.130:42377), 8f57f36297594fffa7635f7e3a205663 (127.12.177.131:38023)
I20260806 18:39:09.301925 15385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be7bf0c6812b43d79a1dbee2fefce60c" candidate_uuid: "7e0dd5c3720c42558202ffb3a31167ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f57f36297594fffa7635f7e3a205663"
I20260806 18:39:09.301951 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be7bf0c6812b43d79a1dbee2fefce60c" candidate_uuid: "7e0dd5c3720c42558202ffb3a31167ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac"
I20260806 18:39:09.302086 15385 raft_consensus.cc:3037] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.302098 15165 raft_consensus.cc:3037] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.303112 15165 raft_consensus.cc:2454] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0dd5c3720c42558202ffb3a31167ab in term 1.
I20260806 18:39:09.303128 15385 raft_consensus.cc:2454] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0dd5c3720c42558202ffb3a31167ab in term 1.
I20260806 18:39:09.303493 14825 leader_election.cc:302] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0dd5c3720c42558202ffb3a31167ab, d4aa29885173436895590ddf89c184ac; no voters:
I20260806 18:39:09.303762 15509 raft_consensus.cc:2781] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:09.304072 15509 raft_consensus.cc:686] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 1 LEADER]: Becoming Leader. State: Replica: 7e0dd5c3720c42558202ffb3a31167ab, State: Running, Role: LEADER
I20260806 18:39:09.304373 15509 consensus_queue.cc:237] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
W20260806 18:39:09.307993 15021 tablet.cc:2369] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:09.309834 14690 catalog_manager.cc:5495] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129). New cstate: current_term: 1 leader_uuid: "7e0dd5c3720c42558202ffb3a31167ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } health_report { overall_health: UNKNOWN } } }
W20260806 18:39:09.350099 15242 tablet.cc:2369] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 18:39:09 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041547, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:09.361971 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.351839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:43361 (local address 127.0.0.1:52100)
0806 18:39:09.352347 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.352361 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.352507 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.352759 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.352761 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.353255 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:09.353439 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.353447 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.354433 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.354436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.355205 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.355216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.355762 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.355765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.355846 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.356641 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:09.356654 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:09.358267 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:09.360104 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:09.360114 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:09.360120 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:09.360386 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:09.360673 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:09.360676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:09.360677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:09.360769 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:09.361270 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:09.361277 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:09.361497 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.361619 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.361804 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":192,"threads_started":1}
I20260806 18:39:09.362110 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.351879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52100 (local address 127.12.177.190:43361)
0806 18:39:09.352051 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.352054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.352449 (+ 395us) server_negotiation.cc:407] Connection header received
0806 18:39:09.352595 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.352597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.352642 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.352714 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:09.353688 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.354295 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.355378 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.355623 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.355715 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.358452 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:09.358455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:09.358457 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:09.358482 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:09.359969 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.360484 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.360487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.360488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.360564 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.360910 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.360912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.360914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.361126 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:09.361221 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.361697 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.361916 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":85}
I20260806 18:39:09.366794 14690 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:52100:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 18:39:09.367691 14690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:09.375054 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4990be87edfb41378475ddbe7fce557f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:09.375013 15138 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4990be87edfb41378475ddbe7fce557f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:09.375013 14912 tablet_service.cc:1467] Processing CreateTablet for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4990be87edfb41378475ddbe7fce557f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:09.375492 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.375489 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.375489 15138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ce85519a81b48bc9b9a36bb2f4ebd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:09.378094 15504 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: Bootstrap starting.
I20260806 18:39:09.379220 15500 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: Bootstrap starting.
I20260806 18:39:09.379259 15499 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: Bootstrap starting.
I20260806 18:39:09.379534 15504 tablet_bootstrap.cc:654] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.380465 15499 tablet_bootstrap.cc:654] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.380700 15500 tablet_bootstrap.cc:654] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:09.382016 15499 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: No bootstrap required, opened a new log
I20260806 18:39:09.382150 15499 ts_tablet_manager.cc:1397] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:09.382652 15500 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: No bootstrap required, opened a new log
I20260806 18:39:09.382782 15500 ts_tablet_manager.cc:1397] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 18:39:09.382782 15504 tablet_bootstrap.cc:492] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: No bootstrap required, opened a new log
I20260806 18:39:09.382871 15504 ts_tablet_manager.cc:1397] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260806 18:39:09.382898 15499 raft_consensus.cc:348] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383038 15499 raft_consensus.cc:374] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.383080 15499 raft_consensus.cc:729] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0dd5c3720c42558202ffb3a31167ab, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.383247 15499 consensus_queue.cc:260] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383354 15504 raft_consensus.cc:348] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383488 15504 raft_consensus.cc:374] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.383523 15504 raft_consensus.cc:729] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f57f36297594fffa7635f7e3a205663, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.383526 15509 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.383667 15509 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.383596 15500 raft_consensus.cc:348] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383653 15504 consensus_queue.cc:260] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383716 15500 raft_consensus.cc:374] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:09.383764 15500 raft_consensus.cc:729] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4aa29885173436895590ddf89c184ac, State: Initialized, Role: FOLLOWER
I20260806 18:39:09.383920 15504 ts_tablet_manager.cc:1428] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260806 18:39:09.383893 15500 consensus_queue.cc:260] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.383978 15499 ts_tablet_manager.cc:1428] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:09.384137 15510 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.384232 15500 ts_tablet_manager.cc:1428] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 18:39:09.384300 15510 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.384202 15511 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.385062 15511 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.532473 15510 raft_consensus.cc:482] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:09.532673 15510 raft_consensus.cc:504] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.533232 15510 leader_election.cc:288] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831), d4aa29885173436895590ddf89c184ac (127.12.177.130:42377)
I20260806 18:39:09.533921 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ce85519a81b48bc9b9a36bb2f4ebd70" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac" is_pre_election: true
I20260806 18:39:09.533921 14940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ce85519a81b48bc9b9a36bb2f4ebd70" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0dd5c3720c42558202ffb3a31167ab" is_pre_election: true
I20260806 18:39:09.534103 14940 raft_consensus.cc:2454] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 0.
I20260806 18:39:09.534104 15165 raft_consensus.cc:2454] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 0.
I20260806 18:39:09.534502 15277 leader_election.cc:302] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7e0dd5c3720c42558202ffb3a31167ab, 8f57f36297594fffa7635f7e3a205663, d4aa29885173436895590ddf89c184ac; no voters:
I20260806 18:39:09.534718 15510 raft_consensus.cc:2781] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:09.534789 15510 raft_consensus.cc:482] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:09.534817 15510 raft_consensus.cc:3037] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.536116 15510 raft_consensus.cc:504] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.536552 15510 leader_election.cc:288] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831), d4aa29885173436895590ddf89c184ac (127.12.177.130:42377)
I20260806 18:39:09.537765 15165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ce85519a81b48bc9b9a36bb2f4ebd70" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4aa29885173436895590ddf89c184ac"
I20260806 18:39:09.537915 15165 raft_consensus.cc:3037] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.537815 14940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ce85519a81b48bc9b9a36bb2f4ebd70" candidate_uuid: "8f57f36297594fffa7635f7e3a205663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0dd5c3720c42558202ffb3a31167ab"
I20260806 18:39:09.538086 14940 raft_consensus.cc:3037] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:09.539191 14940 raft_consensus.cc:2454] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 1.
I20260806 18:39:09.539214 15165 raft_consensus.cc:2454] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f57f36297594fffa7635f7e3a205663 in term 1.
I20260806 18:39:09.539683 15275 leader_election.cc:302] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f57f36297594fffa7635f7e3a205663, d4aa29885173436895590ddf89c184ac; no voters:
I20260806 18:39:09.540019 15510 raft_consensus.cc:2781] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:09.540136 15510 raft_consensus.cc:686] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [term 1 LEADER]: Becoming Leader. State: Replica: 8f57f36297594fffa7635f7e3a205663, State: Running, Role: LEADER
I20260806 18:39:09.540350 15510 consensus_queue.cc:237] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } }
I20260806 18:39:09.541225 15542 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: TxnStatusTablet state changed. Reason: New leader 8f57f36297594fffa7635f7e3a205663. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.541412 15542 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:09.541795 15571 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 18:39:09.541970 15571 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 18:39:09.544075 14693 catalog_manager.cc:5495] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f57f36297594fffa7635f7e3a205663 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:09.585090 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.580613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:38023 (local address 127.0.0.1:41986)
0806 18:39:09.580829 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.580849 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.581029 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.581496 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.581503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.581517 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:09.581627 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.581632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.582704 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.582707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.583395 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.583406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.584199 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.584203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.584283 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.584352 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.584739 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.584758 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.584857 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.584948 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 18:39:09.585214 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.580807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41986 (local address 127.12.177.131:38023)
0806 18:39:09.580988 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.580992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.581011 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:39:09.581202 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.581206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.581263 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.581379 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:09.581742 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.582544 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.583528 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.583884 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.584214 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.584506 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.584612 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.584701 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.584900 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.585071 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:39:09.588254 14940 raft_consensus.cc:1261] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Refusing update from remote peer 8f57f36297594fffa7635f7e3a205663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.588326 15165 raft_consensus.cc:1261] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Refusing update from remote peer 8f57f36297594fffa7635f7e3a205663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.588775 15542 consensus_queue.cc:1035] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.589124 15510 consensus_queue.cc:1035] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.590291 15509 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: TxnStatusTablet state changed. Reason: New leader 8f57f36297594fffa7635f7e3a205663. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.590415 15509 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.592290 15511 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: TxnStatusTablet state changed. Reason: New leader 8f57f36297594fffa7635f7e3a205663. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.592443 15511 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.594609 15510 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.594798 15510 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:09.595307 15542 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.595412 15542 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 8f57f36297594fffa7635f7e3a205663: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:09.596698 15575 mvcc.cc:205] Tried to move back new op lower bound from 7315626187108356096 to 7315626186919235584. Current Snapshot: MvccSnapshot[applied={T|T < 7315626187108356096 or (T in {7315626187108356096})}]
I20260806 18:39:09.596853 15509 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.596992 15509 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P 7e0dd5c3720c42558202ffb3a31167ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.597227 15511 tablet_replica.cc:439] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f57f36297594fffa7635f7e3a205663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0dd5c3720c42558202ffb3a31167ab" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 33831 } } peers { permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 } } peers { permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 } } }
I20260806 18:39:09.597375 15511 tablet_replica.cc:442] T 3ce85519a81b48bc9b9a36bb2f4ebd70 P d4aa29885173436895590ddf89c184ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:09.596881 15576 mvcc.cc:205] Tried to move back new op lower bound from 7315626187108356096 to 7315626186919235584. Current Snapshot: MvccSnapshot[applied={T|T < 7315626187108356096}]
I20260806 18:39:09.609705 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.605281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48818 (local address 127.12.177.129:33831)
0806 18:39:09.605552 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.605559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.605618 (+ 59us) server_negotiation.cc:407] Connection header received
0806 18:39:09.605850 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.605853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.605915 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.606045 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:09.606306 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.606989 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.607936 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.608248 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.608382 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.608691 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.609159 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.609307 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.609382 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.609445 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
I20260806 18:39:09.622797 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.618200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:53123 (local address 127.12.177.131:38023)
0806 18:39:09.618386 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.618390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.618741 (+ 351us) server_negotiation.cc:407] Connection header received
0806 18:39:09.618925 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.618929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.618990 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.619073 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:09.619472 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.620137 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.621488 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.621724 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.621840 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.622276 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.622364 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.622447 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.622558 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.622617 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 18:39:09.623131 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.618091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:38023 (local address 127.12.177.129:53123)
0806 18:39:09.618644 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.618658 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.618805 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.619087 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.619090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.619098 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:09.619369 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.619381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.620268 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.620271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.621330 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.621388 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.621877 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.621884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.622034 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.622111 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.622455 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.622464 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.622535 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.622625 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":191,"threads_started":1}
I20260806 18:39:09.632936 15165 raft_consensus.cc:1261] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Refusing update from remote peer 7e0dd5c3720c42558202ffb3a31167ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.633081 15385 raft_consensus.cc:1261] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Refusing update from remote peer 7e0dd5c3720c42558202ffb3a31167ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:09.633736 15509 consensus_queue.cc:1035] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f57f36297594fffa7635f7e3a205663" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.634330 15555 consensus_queue.cc:1035] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4aa29885173436895590ddf89c184ac" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 42377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:09.663269 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.658680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:36699 (local address 127.12.177.129:33831)
0806 18:39:09.659131 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.659152 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.659375 (+ 223us) server_negotiation.cc:407] Connection header received
0806 18:39:09.659476 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.659478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.659529 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.659591 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:09.659913 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.660537 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.661817 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.662157 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.662274 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.662698 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.662794 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.662873 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.663068 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.663135 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333}
I20260806 18:39:09.663295 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.658582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:33831 (local address 127.12.177.131:36699)
0806 18:39:09.659231 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:09.659249 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:09.659372 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:09.659631 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:09.659634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:09.659644 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:09.659763 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.659770 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.660701 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.660705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.661680 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:09.661690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.662357 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.662362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:09.662461 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.662535 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:09.662942 (+ 407us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:09.662950 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:39:09.663027 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 18:39:09.663106 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":220,"threads_started":1}
I20260806 18:39:09.700388 14690 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:09.700686 14690 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:09.703979 14690 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea9ec9a20abc4c1793d53bdaa60f79a7: Sending DeleteTablet for 3 replicas of tablet be7bf0c6812b43d79a1dbee2fefce60c
I20260806 18:39:09.705123 15138 tablet_service.cc:1514] Processing DeleteTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:54420
I20260806 18:39:09.705135 14912 tablet_service.cc:1514] Processing DeleteTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:48804
I20260806 18:39:09.705905 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet be7bf0c6812b43d79a1dbee2fefce60c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:09 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:41972
I20260806 18:39:09.706436 15611 tablet_replica.cc:330] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: stopping tablet replica
I20260806 18:39:09.706619 15611 raft_consensus.cc:2229] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:09.706773 15611 raft_consensus.cc:2258] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.707156 15609 tablet_replica.cc:330] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: stopping tablet replica
I20260806 18:39:09.707329 15609 raft_consensus.cc:2229] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:09.707684 15611 ts_tablet_manager.cc:1905] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.707715 15609 raft_consensus.cc:2258] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.709832 15609 ts_tablet_manager.cc:1905] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.710207 15608 tablet_replica.cc:330] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: stopping tablet replica
I20260806 18:39:09.710357 15608 raft_consensus.cc:2229] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:09.710507 15608 raft_consensus.cc:2258] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:09.712185 15608 ts_tablet_manager.cc:1905] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:09.715247 15609 ts_tablet_manager.cc:1918] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:09.715571 15609 log.cc:1196] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/be7bf0c6812b43d79a1dbee2fefce60c
I20260806 18:39:09.716024 15609 ts_tablet_manager.cc:1939] T be7bf0c6812b43d79a1dbee2fefce60c P 7e0dd5c3720c42558202ffb3a31167ab: Deleting consensus metadata
I20260806 18:39:09.716606 15608 ts_tablet_manager.cc:1918] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:09.716709 15608 log.cc:1196] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/be7bf0c6812b43d79a1dbee2fefce60c
I20260806 18:39:09.716986 15608 ts_tablet_manager.cc:1939] T be7bf0c6812b43d79a1dbee2fefce60c P d4aa29885173436895590ddf89c184ac: Deleting consensus metadata
I20260806 18:39:09.717058 14676 catalog_manager.cc:4841] TS 7e0dd5c3720c42558202ffb3a31167ab (127.12.177.129:33831): tablet be7bf0c6812b43d79a1dbee2fefce60c (table test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]) successfully deleted
I20260806 18:39:09.718622 15611 ts_tablet_manager.cc:1918] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:09.718734 15611 log.cc:1196] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/be7bf0c6812b43d79a1dbee2fefce60c
I20260806 18:39:09.719033 15611 ts_tablet_manager.cc:1939] T be7bf0c6812b43d79a1dbee2fefce60c P 8f57f36297594fffa7635f7e3a205663: Deleting consensus metadata
I20260806 18:39:09.719995 14676 catalog_manager.cc:4841] TS 8f57f36297594fffa7635f7e3a205663 (127.12.177.131:38023): tablet be7bf0c6812b43d79a1dbee2fefce60c (table test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]) successfully deleted
I20260806 18:39:09.721002 14674 catalog_manager.cc:4841] TS d4aa29885173436895590ddf89c184ac (127.12.177.130:42377): tablet be7bf0c6812b43d79a1dbee2fefce60c (table test-table [id=f4ff15fe4d6f4c7ea35a4b0b16c9f169]) successfully deleted
Aug 06 18:39:09 dist-test-slave-j2vl krb5kdc[14626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:09.730691 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.708283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.12.177.129:33831)
0806 18:39:09.708416 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.708423 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.717650 (+ 9227us) server_negotiation.cc:407] Connection header received
0806 18:39:09.717868 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.717871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.717924 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.717979 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:09.719121 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.719860 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.721615 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.721868 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.721995 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.725944 (+ 3949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:09.725958 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:09.725976 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:09.726010 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:09.728302 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.728873 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.728880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.728881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.728974 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.729281 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.729285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.729286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.729661 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:09.729990 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.730187 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.730339 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 18:39:09.731410 15012 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48830
I20260806 18:39:09.742619 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:09.733311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52116 (local address 127.12.177.190:43361)
0806 18:39:09.733480 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:09.733485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:09.733916 (+ 431us) server_negotiation.cc:407] Connection header received
0806 18:39:09.734190 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:09.734194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:09.734257 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:09.734352 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:09.735237 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.735871 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.736833 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:09.737075 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:09.737191 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:09.739240 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:09.739244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:09.739249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:09.739277 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:09.740789 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.741268 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.741272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.741274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.741413 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:09.741711 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:09.741715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:09.741716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:09.741922 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:09.742069 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:09.742312 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 18:39:09.742448 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 18:39:09.743295 14690 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52116
I20260806 18:39:09.744956 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14803
I20260806 18:39:09.756600 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15037
I20260806 18:39:09.770249 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15257
I20260806 18:39:09.788060 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14646
2026-08-06T18:39:09Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3459 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:09 dist-test-slave-j2vl krb5kdc[15626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:09 dist-test-slave-j2vl krb5kdc[15626](info): set up 2 sockets
Aug 06 18:39:09 dist-test-slave-j2vl krb5kdc[15626](info): commencing operation
krb5kdc: starting...
W20260806 18:39:11.068830 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:11.221261 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45587
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:45587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:11.348232 15644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:11.348624 15644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:11.348713 15644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:11.353057 15644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:11.353188 15644 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 18:39:11.353222 15644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:11.353268 15644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:11.353323 15644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:11.353382 15644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:11.359292 15644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:45587
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:11.360597 15644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:11.362017 15644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:11.372370 15658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:11.372382 15652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:11.372443 15644 server_base.cc:1034] running on GCE node
W20260806 18:39:11.372395 15655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:11.373498 15644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:11.374830 15644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:11.376019 15644 hybrid_clock.cc:648] HybridClock initialized: now 1786041551375985 us; error 54 us; skew 500 ppm
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:11.383953 15644 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:11.385095 15644 webserver.cc:460] Webserver started at http://127.12.177.190:38313/ using document root <none> and password file <none>
I20260806 18:39:11.385823 15644 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:11.385926 15644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:11.386186 15644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:11.388532 15644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "44f710d9ac364def9137d8440193f4c1"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "5c9e5559df5f0c7748415ec207b2c5bb"
server_key_iv: "a7434f149e7bfb9a4a8af77a6eb983f2"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.389117 15644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "44f710d9ac364def9137d8440193f4c1"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "5c9e5559df5f0c7748415ec207b2c5bb"
server_key_iv: "a7434f149e7bfb9a4a8af77a6eb983f2"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.393935 15644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 18:39:11.396513 15668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:11.397989 15644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:11.398108 15644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "44f710d9ac364def9137d8440193f4c1"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "5c9e5559df5f0c7748415ec207b2c5bb"
server_key_iv: "a7434f149e7bfb9a4a8af77a6eb983f2"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.398205 15644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:11.408133 15644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:11.411751 15644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:11.411945 15644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:11.421614 15644 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:45587
I20260806 18:39:11.421643 15764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:45587 every 8 connection(s)
I20260806 18:39:11.422753 15644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:11.425916 15765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:11.430508 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15644
I20260806 18:39:11.430615 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:11.430922 12998 external_mini_cluster.cc:1428] Setting key 76b47f73f575265d626b74e82d98ef91
I20260806 18:39:11.433009 15765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Bootstrap starting.
I20260806 18:39:11.435480 15765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:11.436299 15765 log.cc:824] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:11.438583 15765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: No bootstrap required, opened a new log
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:11.442662 15765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } }
I20260806 18:39:11.442948 15765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:11.443037 15765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44f710d9ac364def9137d8440193f4c1, State: Initialized, Role: FOLLOWER
I20260806 18:39:11.443648 15765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } }
I20260806 18:39:11.443849 15765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:11.443949 15765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:11.444073 15765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:11.445287 15765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } }
I20260806 18:39:11.445690 15765 leader_election.cc:302] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44f710d9ac364def9137d8440193f4c1; no voters:
I20260806 18:39:11.446043 15765 leader_election.cc:288] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:11.446173 15771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:11.446417 15771 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [term 1 LEADER]: Becoming Leader. State: Replica: 44f710d9ac364def9137d8440193f4c1, State: Running, Role: LEADER
I20260806 18:39:11.446470 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.432715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44804 (local address 127.12.177.190:45587)
0806 18:39:11.433307 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:11.433325 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:11.433408 (+ 83us) server_negotiation.cc:407] Connection header received
0806 18:39:11.434140 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:11.434158 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:11.434510 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:11.434909 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:11.435799 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.436870 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.437808 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.438299 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.438492 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.441175 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:11.441181 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:11.441196 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:11.441228 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:11.443070 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.443633 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.443638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.443644 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.443807 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.444122 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.444124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.444125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.444571 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:11.444743 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:11.445023 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 18:39:11.445342 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":175,"threads_started":1}
I20260806 18:39:11.447167 15771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } }
I20260806 18:39:11.447409 15765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:11.449191 15772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44f710d9ac364def9137d8440193f4c1. Latest consensus state: current_term: 1 leader_uuid: "44f710d9ac364def9137d8440193f4c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } } }
I20260806 18:39:11.449357 15772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:11.449198 15775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44f710d9ac364def9137d8440193f4c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44f710d9ac364def9137d8440193f4c1" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45587 } } }
I20260806 18:39:11.450019 15775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1 [sys.catalog]: This master's current role is: LEADER
W20260806 18:39:11.452273 15802 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:39:11.452370 15802 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:39:11.452454 15800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:11.453166 15800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:11.459218 15800 catalog_manager.cc:1347] Generated new cluster ID: bd965c637fd64d27a7c8abd94fbd53cb
I20260806 18:39:11.459297 15800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:11.478721 15800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:11.479907 15800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:11.488018 15800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Generated new TSK 0
I20260806 18:39:11.488878 15800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:11.526540 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45587
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:11.657667 15809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:11.658051 15809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:11.658142 15809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:11.662508 15809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:11.662635 15809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:11.662719 15809 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 18:39:11.662767 15809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:11.662840 15809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:11.669044 15809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:11.670387 15809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:11.671526 15809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:11.682822 15816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:11.682853 15820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:11.682822 15814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:11.682906 15809 server_base.cc:1034] running on GCE node
I20260806 18:39:11.683713 15809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:11.684484 15809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:11.685715 15809 hybrid_clock.cc:648] HybridClock initialized: now 1786041551685672 us; error 64 us; skew 500 ppm
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:11.689036 15809 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:11.690198 15809 webserver.cc:460] Webserver started at http://127.12.177.129:36953/ using document root <none> and password file <none>
I20260806 18:39:11.690913 15809 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:11.691023 15809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:11.691279 15809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:11.693611 15809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "0d0879e6a11844959642e9e710b5d29b"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "638489b424f8e6f48b1ceeaf1cb70094"
server_key_iv: "e5d40ccb4553b7343295dcd16bfbe916"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.694247 15809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "0d0879e6a11844959642e9e710b5d29b"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "638489b424f8e6f48b1ceeaf1cb70094"
server_key_iv: "e5d40ccb4553b7343295dcd16bfbe916"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.698436 15809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:11.701683 15833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:11.703256 15809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:11.703421 15809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "0d0879e6a11844959642e9e710b5d29b"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "638489b424f8e6f48b1ceeaf1cb70094"
server_key_iv: "e5d40ccb4553b7343295dcd16bfbe916"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.703562 15809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:11.714089 15809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:11.717922 15809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:11.718161 15809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:11.719761 15809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:11.719846 15809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:11.719921 15809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:11.719964 15809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:11.732206 15809 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:38507
I20260806 18:39:11.732285 16008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:38507 every 8 connection(s)
I20260806 18:39:11.733574 15809 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:11.736476 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15809
I20260806 18:39:11.736583 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.720976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:49225 (local address 127.12.177.190:45587)
0806 18:39:11.721117 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:11.721121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:11.722326 (+ 1205us) server_negotiation.cc:407] Connection header received
0806 18:39:11.723978 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:11.723982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:11.724061 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:11.724173 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:11.726043 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.726706 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.728161 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.728424 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.728562 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.732093 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:11.732096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:11.732099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:11.732130 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:11.733937 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.734648 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.734653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.734655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.734778 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.735231 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.735234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.735235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.735450 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:11.735552 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:11.736273 (+ 721us) server_negotiation.cc:299] Negotiation successful
0806 18:39:11.736411 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 18:39:11.736610 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:11.736940 12998 external_mini_cluster.cc:1428] Setting key 49aea39e0ed2ccdea136c485369d2abe
I20260806 18:39:11.737902 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.721585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.129:49225)
0806 18:39:11.722141 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:11.722191 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:11.723621 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:11.724351 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:11.724359 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:11.724970 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:11.725810 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.725833 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.726854 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.726857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.728022 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.728033 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.728628 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.728634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.728869 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.729705 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:11.729733 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:11.731822 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:11.734087 (+ 2265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.734093 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.734112 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.734514 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.734890 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.734893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.734895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.735040 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.735606 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:11.735612 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:11.735887 (+ 275us) client_negotiation.cc:769] Sending connection context
0806 18:39:11.736213 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 18:39:11.736636 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":148,"threads_started":1}
I20260806 18:39:11.739599 16009 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45587
I20260806 18:39:11.739800 16009 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:11.740473 16009 heartbeater.cc:511] Master 127.12.177.190:45587 requested a full tablet report, sending...
I20260806 18:39:11.742576 15692 ts_manager.cc:194] Registered new tserver with Master: 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507)
I20260806 18:39:11.744354 15692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:49225
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:11.752472 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.742084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.129:33459)
0806 18:39:11.742472 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:11.742484 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:11.742627 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:11.742914 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:11.742917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:11.743165 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:11.743291 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.743297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.744514 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.744521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.745793 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.745810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.746490 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.746496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.746727 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.747473 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:11.747497 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:11.748130 (+ 633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:11.750521 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.750525 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.750527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.750811 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.751200 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.751204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.751206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.751316 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.751842 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:11.751845 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:11.751956 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 18:39:11.752103 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 18:39:11.752283 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":24,"thread_start_us":135,"threads_started":1}
I20260806 18:39:11.752583 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.742148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:33459 (local address 127.12.177.190:45587)
0806 18:39:11.742289 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:11.742293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:11.742570 (+ 277us) server_negotiation.cc:407] Connection header received
0806 18:39:11.742751 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:11.742755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:11.742798 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:11.742892 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:11.743424 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.744307 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.745980 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.746325 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.746449 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.748513 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:11.748516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:11.748518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:11.748545 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:11.750372 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.750976 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.750980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.750982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.751082 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.751459 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.751463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.751465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.751709 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:11.751816 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:11.752206 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 18:39:11.752416 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:11.778556 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45587
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:11.905580 16021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:11.905964 16021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:11.906062 16021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:11.910533 16021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:11.910619 16021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:11.910670 16021 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 18:39:11.910717 16021 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:11.910849 16021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:11.917158 16021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:11.918475 16021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:11.919611 16021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:11.931033 16028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:11.931223 16021 server_base.cc:1034] running on GCE node
W20260806 18:39:11.931277 16027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:11.931098 16032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:11.932049 16021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:11.933184 16021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:11.934417 16021 hybrid_clock.cc:648] HybridClock initialized: now 1786041551934400 us; error 35 us; skew 500 ppm
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:11.937974 16021 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:11.939393 16021 webserver.cc:460] Webserver started at http://127.12.177.130:34669/ using document root <none> and password file <none>
I20260806 18:39:11.940126 16021 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:11.940237 16021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:11.940505 16021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:11.942924 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "2cd2eba33b6f47e18c94612a200b089a"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "c30ce8d6624b0c0ab66b72800ce05a19"
server_key_iv: "f2a00bb56fd1bc1f2a08d38c9e20b4da"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.943598 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "2cd2eba33b6f47e18c94612a200b089a"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "c30ce8d6624b0c0ab66b72800ce05a19"
server_key_iv: "f2a00bb56fd1bc1f2a08d38c9e20b4da"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.948247 16021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:11.951507 16041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:11.953049 16021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:11.953235 16021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "2cd2eba33b6f47e18c94612a200b089a"
format_stamp: "Formatted at 2026-08-06 18:39:11 on dist-test-slave-j2vl"
server_key: "c30ce8d6624b0c0ab66b72800ce05a19"
server_key_iv: "f2a00bb56fd1bc1f2a08d38c9e20b4da"
server_key_version: "encryptionkey@0"
I20260806 18:39:11.953475 16021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:11.974848 16021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:11.978859 16021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:11.979241 16021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:11.981189 16021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:11.981278 16021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:11.981345 16021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:11.981406 16021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 06 18:39:11 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:11.993238 16021 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:43343
I20260806 18:39:11.993310 16206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:43343 every 8 connection(s)
I20260806 18:39:11.994621 16021 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:11.997040 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.982322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:49915 (local address 127.12.177.190:45587)
0806 18:39:11.982493 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:11.982500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:11.983443 (+ 943us) server_negotiation.cc:407] Connection header received
0806 18:39:11.984999 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:11.985005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:11.985104 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:11.985218 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:11.986737 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.987537 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.989405 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.989811 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.989950 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.992801 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:11.992805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:11.992807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:11.992845 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:11.994760 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.995397 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.995401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.995403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.995507 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:11.995883 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:11.995887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:11.995889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:11.996101 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:11.996217 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:11.996729 (+ 512us) server_negotiation.cc:299] Negotiation successful
0806 18:39:11.996870 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 18:39:11.997684 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 16021
I20260806 18:39:11.997821 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:11.998018 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:11.982702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.130:49915)
0806 18:39:11.983245 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:11.983318 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:11.984639 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:11.985475 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:11.985485 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:11.986007 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:11.986561 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.986575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.987758 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.987761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.989236 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:11.989247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:11.990007 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:11.990011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:11.990223 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:11.990919 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:11.990943 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:11.992581 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:11.994892 (+ 2311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.994897 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.994911 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.995254 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.995616 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:11.995619 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:11.995621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:11.995772 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:11.996214 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:11.996221 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:11.996482 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 18:39:11.996682 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 18:39:11.997025 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":112,"threads_started":1}
I20260806 18:39:11.998121 12998 external_mini_cluster.cc:1428] Setting key e926c2fc486126209c4158aa26ca7033
I20260806 18:39:11.999763 16207 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45587
I20260806 18:39:11.999958 16207 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:12.000520 16207 heartbeater.cc:511] Master 127.12.177.190:45587 requested a full tablet report, sending...
I20260806 18:39:12.001783 15692 ts_manager.cc:194] Registered new tserver with Master: 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343)
I20260806 18:39:12.002660 15692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:49915
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:12.011382 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.002703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:50659 (local address 127.12.177.190:45587)
0806 18:39:12.002826 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.002831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.003075 (+ 244us) server_negotiation.cc:407] Connection header received
0806 18:39:12.003235 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.003238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.003288 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.003366 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:12.004122 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.004886 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.005879 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.006277 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.006406 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.007855 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:12.007858 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:12.007860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:12.007925 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:12.009576 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.010034 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.010038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.010040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.010125 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.010429 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.010433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.010435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.010681 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:12.010801 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.011076 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.011206 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 18:39:12.011406 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.002650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.130:50659)
0806 18:39:12.002978 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.002991 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.003121 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.003422 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.003427 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.003719 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:12.003973 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.003983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.005044 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.005047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.005709 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.005718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.006406 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.006409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.006478 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.007090 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:12.007110 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:12.007699 (+ 589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:12.009701 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.009704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.009706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.009930 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.010224 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.010228 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.010230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.010322 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.010789 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:12.010792 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:12.010902 (+ 110us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.011016 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.011187 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":22,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:12.038072 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45587
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:12.163168 16217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:12.163545 16217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:12.163645 16217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:12.168123 16217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:12.168254 16217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:12.168344 16217 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 18:39:12.168391 16217 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:12.168466 16217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:12.174583 16217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:12.175908 16217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:12.177075 16217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:12.188354 16228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:12.188346 16223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:12.188347 16224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:12.188498 16217 server_base.cc:1034] running on GCE node
I20260806 18:39:12.189124 16217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:12.189913 16217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:12.191112 16217 hybrid_clock.cc:648] HybridClock initialized: now 1786041552191093 us; error 30 us; skew 500 ppm
Aug 06 18:39:12 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041552, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:12.194262 16217 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:12.195266 16217 webserver.cc:460] Webserver started at http://127.12.177.131:39817/ using document root <none> and password file <none>
I20260806 18:39:12.195905 16217 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:12.196003 16217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:12.196271 16217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:12.198637 16217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "34dabb6789a8419d8e659d8fbb45471d"
format_stamp: "Formatted at 2026-08-06 18:39:12 on dist-test-slave-j2vl"
server_key: "37d695fa82b49410313d9720ac03ba13"
server_key_iv: "eb0912b1e21ecc6f3c3de39c5d001dfa"
server_key_version: "encryptionkey@0"
I20260806 18:39:12.199327 16217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "34dabb6789a8419d8e659d8fbb45471d"
format_stamp: "Formatted at 2026-08-06 18:39:12 on dist-test-slave-j2vl"
server_key: "37d695fa82b49410313d9720ac03ba13"
server_key_iv: "eb0912b1e21ecc6f3c3de39c5d001dfa"
server_key_version: "encryptionkey@0"
I20260806 18:39:12.203986 16217 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:12.206772 16238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:12.208273 16217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:12.208426 16217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "34dabb6789a8419d8e659d8fbb45471d"
format_stamp: "Formatted at 2026-08-06 18:39:12 on dist-test-slave-j2vl"
server_key: "37d695fa82b49410313d9720ac03ba13"
server_key_iv: "eb0912b1e21ecc6f3c3de39c5d001dfa"
server_key_version: "encryptionkey@0"
I20260806 18:39:12.208562 16217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:12.242561 16217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:12.246230 16217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:12.246510 16217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:12.248306 16217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:12.248451 16217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:12.248533 16217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:12.248582 16217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:12 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041552, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:12.262091 16217 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:35947
I20260806 18:39:12.262092 16406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:35947 every 8 connection(s)
I20260806 18:39:12.263307 16217 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:12.265261 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.249761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:37865 (local address 127.12.177.190:45587)
0806 18:39:12.249909 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.249914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.251247 (+ 1333us) server_negotiation.cc:407] Connection header received
0806 18:39:12.252549 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.252553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.252617 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.252712 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:12.254749 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.255332 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.256685 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.256955 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.257082 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.260179 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:12.260183 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:12.260185 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:12.260214 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:12.262371 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.263264 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.263271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.263276 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.263389 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.263913 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.263918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.263920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.264198 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:12.264316 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.264993 (+ 677us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.265128 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 18:39:12.266211 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.250453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.131:37865)
0806 18:39:12.251052 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.251107 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.252290 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.252932 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.252944 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.253550 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:12.254519 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.254547 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.255490 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.255494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.256554 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.256566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.257166 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.257170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.257438 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.258224 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:12.258249 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:12.259958 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:12.262588 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.262595 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.262614 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.263111 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.263516 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.263520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.263522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.263731 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.264374 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:12.264380 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:12.264694 (+ 314us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.264877 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.265168 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":166,"threads_started":1}
I20260806 18:39:12.267809 16407 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45587
I20260806 18:39:12.268075 16407 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:12.268886 16407 heartbeater.cc:511] Master 127.12.177.190:45587 requested a full tablet report, sending...
I20260806 18:39:12.269702 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 16217
I20260806 18:39:12.269824 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:12.270143 12998 external_mini_cluster.cc:1428] Setting key 1dfcbfd0a89ebe3a1b17bd0a86299039
I20260806 18:39:12.271114 15687 ts_manager.cc:194] Registered new tserver with Master: 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947)
I20260806 18:39:12.271808 15687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:37865
I20260806 18:39:12.272774 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:39:12.283185 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.272368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:40991 (local address 127.12.177.190:45587)
0806 18:39:12.272499 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.272509 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.273762 (+ 1253us) server_negotiation.cc:407] Connection header received
0806 18:39:12.274047 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.274052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.274119 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.274176 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:12.275454 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.276286 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.277627 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.277867 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.277990 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.279390 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:12.279395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:12.279403 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:12.279428 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:12.280951 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.281583 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.281587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.281589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.281679 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.282018 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.282024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.282030 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.282228 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:12.282357 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.282767 (+ 410us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.282923 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:12.283916 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.272591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.12.177.131:40991)
0806 18:39:12.273614 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.273632 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.273899 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.274500 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.274503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.274961 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:12.275235 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.275271 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.276489 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.276496 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.277500 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.277511 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.277997 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.278001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.278099 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.278843 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:12.278855 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:12.279219 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:12.281086 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.281089 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.281091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.281477 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.281800 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.281804 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.281807 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.281907 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.282414 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:12.282418 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:12.282537 (+ 119us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.283386 (+ 849us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.283595 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"thread_start_us":131,"threads_started":1}
Aug 06 18:39:12 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 18:39:12 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:12.311223 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.300069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.12.177.190:45587)
0806 18:39:12.300289 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.300296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.300395 (+ 99us) server_negotiation.cc:407] Connection header received
0806 18:39:12.300542 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.300549 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.300635 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.300726 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:12.301695 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.302568 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.303707 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.304111 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.304249 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.307132 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:12.307139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:12.307145 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:12.307186 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:12.309117 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.309669 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.309676 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.309680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.309784 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.310140 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.310146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.310151 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.310434 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:12.310572 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.310844 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.310991 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 18:39:12.315423 15692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:12.319103 15692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:12.337113 16430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.330293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.0.0.1:51938)
0806 18:39:12.330654 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.330707 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.330990 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.332209 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.332215 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.332241 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.332415 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.332421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.333709 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.333712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.335283 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.335294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.336478 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.336484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.336642 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.336685 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.336825 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.336963 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
I20260806 18:39:12.337170 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.331164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51938 (local address 127.12.177.131:35947)
0806 18:39:12.331536 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.331549 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.331574 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:39:12.331658 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.331664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.331906 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.332230 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.332557 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.333580 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.335432 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.336343 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.336586 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.336745 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.336855 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.336953 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":134,"threads_started":1}
I20260806 18:39:12.338387 16431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.330329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38507 (local address 127.0.0.1:43390)
0806 18:39:12.330761 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.330776 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.330911 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.334243 (+ 3332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.334247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.334266 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.334360 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.334366 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.335741 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.335745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.336783 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.336793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.337973 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.337977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.338070 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.338116 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.338168 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.338242 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":127,"threads_started":1}
I20260806 18:39:12.339250 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.331315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43390 (local address 127.12.177.129:38507)
0806 18:39:12.333591 (+ 2276us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.333598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.333624 (+ 26us) server_negotiation.cc:407] Connection header received
0806 18:39:12.333704 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.333709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.333900 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.334515 (+ 615us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.334654 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.335631 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.336935 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.337823 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.338730 (+ 907us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.338901 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.338984 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.339114 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2141,"thread_start_us":98,"threads_started":1}
I20260806 18:39:12.339330 16432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.331060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43343 (local address 127.0.0.1:44046)
0806 18:39:12.332369 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.332387 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.332655 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.333198 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.333201 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.333221 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.333368 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.333374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.336129 (+ 2755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.336132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.337442 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.337453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.338887 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.338891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.339038 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.339065 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.339134 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.339206 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1233,"thread_start_us":101,"threads_started":1}
I20260806 18:39:12.339839 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.331708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.12.177.130:43343)
0806 18:39:12.332206 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.332220 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.332653 (+ 433us) server_negotiation.cc:407] Connection header received
0806 18:39:12.332786 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.332795 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.332992 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.333195 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.333488 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.336001 (+ 2513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.337589 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.338759 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.339051 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.339177 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.339227 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.339625 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":143,"threads_started":1}
I20260806 18:39:12.342397 15907 tablet_service.cc:1467] Processing CreateTablet for tablet 3adb7064177a4c59a73431483dbc2d81 (DEFAULT_TABLE table=test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.342864 16116 tablet_service.cc:1467] Processing CreateTablet for tablet 3adb7064177a4c59a73431483dbc2d81 (DEFAULT_TABLE table=test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.343710 15907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adb7064177a4c59a73431483dbc2d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.343925 16116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adb7064177a4c59a73431483dbc2d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.340996 16306 tablet_service.cc:1467] Processing CreateTablet for tablet 3adb7064177a4c59a73431483dbc2d81 (DEFAULT_TABLE table=test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.345088 16306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adb7064177a4c59a73431483dbc2d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.353639 16438 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Bootstrap starting.
I20260806 18:39:12.352478 16436 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Bootstrap starting.
I20260806 18:39:12.355259 16440 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Bootstrap starting.
I20260806 18:39:12.356340 16438 tablet_bootstrap.cc:654] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.356658 16436 tablet_bootstrap.cc:654] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.357235 16438 log.cc:824] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:12.357863 16440 tablet_bootstrap.cc:654] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.358253 16436 log.cc:824] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:12.358974 16440 log.cc:824] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:12.360180 16438 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: No bootstrap required, opened a new log
I20260806 18:39:12.360402 16438 ts_tablet_manager.cc:1397] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260806 18:39:12.360646 16436 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: No bootstrap required, opened a new log
I20260806 18:39:12.360924 16436 ts_tablet_manager.cc:1397] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260806 18:39:12.361145 16440 tablet_bootstrap.cc:492] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: No bootstrap required, opened a new log
I20260806 18:39:12.361886 16440 ts_tablet_manager.cc:1397] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:39:12.365223 16438 raft_consensus.cc:348] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.365579 16438 raft_consensus.cc:374] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.365651 16438 raft_consensus.cc:729] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.366183 16438 consensus_queue.cc:260] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.366571 16440 raft_consensus.cc:348] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.366853 16440 raft_consensus.cc:374] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.366911 16440 raft_consensus.cc:729] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.366950 16436 raft_consensus.cc:348] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.367228 16207 heartbeater.cc:503] Master 127.12.177.190:45587 was elected leader, sending a full tablet report...
I20260806 18:39:12.367216 16436 raft_consensus.cc:374] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.367409 16436 raft_consensus.cc:729] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.367383 16440 consensus_queue.cc:260] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.367481 16438 ts_tablet_manager.cc:1428] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Time spent starting tablet: real 0.007s user 0.008s sys 0.001s
I20260806 18:39:12.368196 16436 consensus_queue.cc:260] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.368347 16407 heartbeater.cc:503] Master 127.12.177.190:45587 was elected leader, sending a full tablet report...
I20260806 18:39:12.368462 16440 ts_tablet_manager.cc:1428] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 18:39:12.369967 16436 ts_tablet_manager.cc:1428] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260806 18:39:12.370374 16009 heartbeater.cc:503] Master 127.12.177.190:45587 was elected leader, sending a full tablet report...
I20260806 18:39:12.387399 16448 raft_consensus.cc:482] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:12.387629 16448 raft_consensus.cc:504] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.389082 16448 leader_election.cc:288] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947), 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507)
I20260806 18:39:12.394248 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.389401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.12.177.130:36325)
0806 18:39:12.389556 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.389578 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.389693 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.390025 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.390028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.390049 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.390215 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.390221 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.391258 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.391261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.392847 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.392858 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.393762 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.393765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.393886 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.393922 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.393993 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.394071 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":88}
I20260806 18:39:12.394325 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.389589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:36325 (local address 127.12.177.131:35947)
0806 18:39:12.389739 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.389746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.389764 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:39:12.389825 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.389828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.389895 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.389976 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.390339 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.391153 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.392982 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.393584 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.393700 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.393773 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.394126 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.394201 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:39:12.394507 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.389619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:53655 (local address 127.12.177.129:38507)
0806 18:39:12.389756 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.389762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.390363 (+ 601us) server_negotiation.cc:407] Connection header received
0806 18:39:12.390468 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.390470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.390514 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.390575 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.391026 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.391746 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.393007 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.393869 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.394012 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.394058 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.394272 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.394363 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 18:39:12.394876 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.389414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38507 (local address 127.12.177.130:53655)
0806 18:39:12.390113 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.390124 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.390364 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.390613 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.390616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.390635 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.390914 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.390921 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.391872 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.391874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.392847 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.392858 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.394011 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.394018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.394137 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.394157 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.394252 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.394703 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":298,"thread_start_us":139,"threads_started":1}
I20260806 18:39:12.395270 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adb7064177a4c59a73431483dbc2d81" candidate_uuid: "2cd2eba33b6f47e18c94612a200b089a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d" is_pre_election: true
I20260806 18:39:12.395641 15940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adb7064177a4c59a73431483dbc2d81" candidate_uuid: "2cd2eba33b6f47e18c94612a200b089a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b" is_pre_election: true
I20260806 18:39:12.395658 16336 raft_consensus.cc:2454] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd2eba33b6f47e18c94612a200b089a in term 0.
I20260806 18:39:12.395921 15940 raft_consensus.cc:2454] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cd2eba33b6f47e18c94612a200b089a in term 0.
I20260806 18:39:12.396327 16045 leader_election.cc:302] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd2eba33b6f47e18c94612a200b089a, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:12.396715 16448 raft_consensus.cc:2781] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:12.396798 16448 raft_consensus.cc:482] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:12.396828 16448 raft_consensus.cc:3037] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.398329 16448 raft_consensus.cc:504] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.398720 16448 leader_election.cc:288] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [CANDIDATE]: Term 1 election: Requested vote from peers 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947), 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507)
I20260806 18:39:12.399338 15940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adb7064177a4c59a73431483dbc2d81" candidate_uuid: "2cd2eba33b6f47e18c94612a200b089a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b"
I20260806 18:39:12.399524 15940 raft_consensus.cc:3037] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.401315 15940 raft_consensus.cc:2454] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd2eba33b6f47e18c94612a200b089a in term 1.
I20260806 18:39:12.401661 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adb7064177a4c59a73431483dbc2d81" candidate_uuid: "2cd2eba33b6f47e18c94612a200b089a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d"
I20260806 18:39:12.401719 16046 leader_election.cc:302] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 2cd2eba33b6f47e18c94612a200b089a; no voters:
I20260806 18:39:12.401818 16336 raft_consensus.cc:3037] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.401911 16448 raft_consensus.cc:2781] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:12.402297 16448 raft_consensus.cc:686] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 1 LEADER]: Becoming Leader. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Running, Role: LEADER
I20260806 18:39:12.402741 16448 consensus_queue.cc:237] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } }
I20260806 18:39:12.403355 16336 raft_consensus.cc:2454] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cd2eba33b6f47e18c94612a200b089a in term 1.
I20260806 18:39:12.406409 15689 catalog_manager.cc:5495] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130). New cstate: current_term: 1 leader_uuid: "2cd2eba33b6f47e18c94612a200b089a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } health_report { overall_health: HEALTHY } } }
Aug 06 18:39:12 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041551, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:12.461586 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.451436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45587 (local address 127.0.0.1:44832)
0806 18:39:12.451901 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.451915 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.452234 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.452499 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.452502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.452988 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:12.453087 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.453094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.453949 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.453954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.454586 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.454597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.455214 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.455217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.455301 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.455979 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:12.455993 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:12.457898 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:12.459783 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.459797 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.459806 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.460067 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.460372 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:12.460376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:12.460378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:12.460465 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:12.460886 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:12.460897 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:12.461025 (+ 128us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.461148 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.461369 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":135,"threads_started":1}
I20260806 18:39:12.461586 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.451547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44832 (local address 127.12.177.190:45587)
0806 18:39:12.451725 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.451731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.452159 (+ 428us) server_negotiation.cc:407] Connection header received
0806 18:39:12.452345 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.452348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.452391 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.452479 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:12.453223 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.453834 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.454815 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.455063 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.455203 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.458090 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:12.458093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:12.458095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:12.458119 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:12.459651 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.460178 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.460183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.460185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.460266 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:12.460554 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:12.460559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:12.460561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:12.460762 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:12.460886 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.461208 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.461465 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":52}
I20260806 18:39:12.468011 15689 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44832:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 18:39:12.469049 15689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:12.475164 16116 tablet_service.cc:1467] Processing CreateTablet for tablet 8570cce8eed54cb388ad0af25ea70929 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=19fadfe15fe04a37912eeecbab78aca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:12.475426 16306 tablet_service.cc:1467] Processing CreateTablet for tablet 8570cce8eed54cb388ad0af25ea70929 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=19fadfe15fe04a37912eeecbab78aca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:12.475265 15907 tablet_service.cc:1467] Processing CreateTablet for tablet 8570cce8eed54cb388ad0af25ea70929 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=19fadfe15fe04a37912eeecbab78aca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:12.476019 15907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8570cce8eed54cb388ad0af25ea70929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.476018 16306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8570cce8eed54cb388ad0af25ea70929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.476027 16116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8570cce8eed54cb388ad0af25ea70929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.478844 16438 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: Bootstrap starting.
I20260806 18:39:12.480059 16436 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: Bootstrap starting.
I20260806 18:39:12.480152 16440 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: Bootstrap starting.
I20260806 18:39:12.480556 16438 tablet_bootstrap.cc:654] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.481230 16436 tablet_bootstrap.cc:654] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.481639 16440 tablet_bootstrap.cc:654] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.482897 16438 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: No bootstrap required, opened a new log
I20260806 18:39:12.483004 16438 ts_tablet_manager.cc:1397] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 18:39:12.483678 16438 raft_consensus.cc:348] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.483820 16438 raft_consensus.cc:374] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.483858 16438 raft_consensus.cc:729] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.483865 16440 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: No bootstrap required, opened a new log
I20260806 18:39:12.483954 16440 ts_tablet_manager.cc:1397] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 18:39:12.484011 16438 consensus_queue.cc:260] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.484387 16438 ts_tablet_manager.cc:1428] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:12.484344 16448 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.484480 16448 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.485222 16440 raft_consensus.cc:348] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.485423 16440 raft_consensus.cc:374] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.485483 16440 raft_consensus.cc:729] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.485630 16440 consensus_queue.cc:260] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.485909 16436 tablet_bootstrap.cc:492] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: No bootstrap required, opened a new log
W20260806 18:39:12.485987 16010 tablet.cc:2369] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:12.486068 16440 ts_tablet_manager.cc:1428] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 18:39:12.486018 16436 ts_tablet_manager.cc:1397] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260806 18:39:12.487035 16450 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.487233 16450 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.487901 16436 raft_consensus.cc:348] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.488125 16436 raft_consensus.cc:374] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.488166 16436 raft_consensus.cc:729] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.488315 16436 consensus_queue.cc:260] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.488591 16436 ts_tablet_manager.cc:1428] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 18:39:12.488596 16452 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.488978 16452 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 18:39:12.496055 16209 tablet.cc:2369] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:12.514914 16409 tablet.cc:2369] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:12.549507 16450 raft_consensus.cc:482] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:12.549674 16450 raft_consensus.cc:504] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.550905 16450 leader_election.cc:288] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507), 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343)
I20260806 18:39:12.555217 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.551408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:60551 (local address 127.12.177.129:38507)
0806 18:39:12.551557 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.551565 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.551584 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:39:12.551648 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.551651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.551740 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.551839 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.552368 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.552978 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.554074 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.554555 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.554691 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.554763 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.555011 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.555091 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:39:12.555335 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.551151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38507 (local address 127.12.177.131:60551)
0806 18:39:12.551383 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.551402 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.551532 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.551977 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.551981 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.552003 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.552231 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.552239 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.553098 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.553103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.553943 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.553952 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.554691 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.554695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.554875 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.554895 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.554990 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.555069 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":6}
I20260806 18:39:12.556037 15940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8570cce8eed54cb388ad0af25ea70929" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b" is_pre_election: true
I20260806 18:39:12.556242 15940 raft_consensus.cc:2454] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 0.
I20260806 18:39:12.556546 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.551953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59721 (local address 127.12.177.130:43343)
0806 18:39:12.552079 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.552085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.552342 (+ 257us) server_negotiation.cc:407] Connection header received
0806 18:39:12.552574 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.552579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.552634 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.552732 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.553174 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.553777 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.555074 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.555617 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.555739 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.555777 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.556275 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.556393 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:12.556597 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.551522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43343 (local address 127.12.177.131:59721)
0806 18:39:12.552071 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.552087 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.552426 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.552755 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.552758 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.552774 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.553049 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.553056 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.553906 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.553909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.554935 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.554944 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.555768 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.555772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.556066 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.556089 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.556196 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.556310 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":26,"thread_start_us":182,"threads_started":1}
I20260806 18:39:12.556703 16244 leader_election.cc:302] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:12.557050 16450 raft_consensus.cc:2781] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:12.557130 16450 raft_consensus.cc:482] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:12.557184 16450 raft_consensus.cc:3037] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.557559 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8570cce8eed54cb388ad0af25ea70929" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a" is_pre_election: true
I20260806 18:39:12.557819 16124 raft_consensus.cc:2454] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 0.
I20260806 18:39:12.558923 16450 raft_consensus.cc:504] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.559324 16450 leader_election.cc:288] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 election: Requested vote from peers 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507), 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343)
I20260806 18:39:12.559902 15940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8570cce8eed54cb388ad0af25ea70929" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b"
I20260806 18:39:12.559927 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8570cce8eed54cb388ad0af25ea70929" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a"
I20260806 18:39:12.560038 15940 raft_consensus.cc:3037] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.560070 16124 raft_consensus.cc:3037] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.561255 16124 raft_consensus.cc:2454] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 1.
I20260806 18:39:12.561256 15940 raft_consensus.cc:2454] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 1.
I20260806 18:39:12.561652 16244 leader_election.cc:302] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd2eba33b6f47e18c94612a200b089a, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:12.561942 16450 raft_consensus.cc:2781] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:12.562219 16450 raft_consensus.cc:686] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [term 1 LEADER]: Becoming Leader. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Running, Role: LEADER
I20260806 18:39:12.562630 16450 consensus_queue.cc:237] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.565333 16475 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: TxnStatusTablet state changed. Reason: New leader 34dabb6789a8419d8e659d8fbb45471d. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.565538 16475 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:12.566220 16477 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 18:39:12.566473 16477 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 18:39:12.566620 15692 catalog_manager.cc:5495] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131). New cstate: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:12.602126 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.596587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.0.0.1:51940)
0806 18:39:12.596879 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.596897 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.597053 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.597602 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.597606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.597615 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:12.597800 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.597807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.598744 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.598748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.599786 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.599800 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.600458 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.600463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.600567 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.600643 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.601730 (+ 1087us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.601754 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.601839 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.601963 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260806 18:39:12.602242 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.596739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51940 (local address 127.12.177.131:35947)
0806 18:39:12.596894 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.596898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.597033 (+ 135us) server_negotiation.cc:407] Connection header received
0806 18:39:12.597378 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.597384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.597459 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.597549 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:12.597972 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.598599 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.600084 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.600318 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.600416 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.600898 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.601621 (+ 723us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.601727 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.601904 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.601971 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 18:39:12.608696 15940 raft_consensus.cc:1261] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Refusing update from remote peer 34dabb6789a8419d8e659d8fbb45471d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:12.608695 16124 raft_consensus.cc:1261] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Refusing update from remote peer 34dabb6789a8419d8e659d8fbb45471d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:12.609458 16475 consensus_queue.cc:1035] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:12.609655 16450 consensus_queue.cc:1035] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:12.613706 16448 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: TxnStatusTablet state changed. Reason: New leader 34dabb6789a8419d8e659d8fbb45471d. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.613879 16448 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.614552 16452 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: TxnStatusTablet state changed. Reason: New leader 34dabb6789a8419d8e659d8fbb45471d. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.614686 16452 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.618599 16450 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.618748 16450 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:12.619096 16483 mvcc.cc:205] Tried to move back new op lower bound from 7315626199476051968 to 7315626199299371008. Current Snapshot: MvccSnapshot[applied={T|T < 7315626199476051968}]
I20260806 18:39:12.620433 16475 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.620574 16475 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 34dabb6789a8419d8e659d8fbb45471d: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:12.621670 16485 mvcc.cc:205] Tried to move back new op lower bound from 7315626199476051968 to 7315626199299371008. Current Snapshot: MvccSnapshot[applied={T|T < 7315626199476051968}]
I20260806 18:39:12.622169 16452 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.622303 16452 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 0d0879e6a11844959642e9e710b5d29b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.622501 16448 tablet_replica.cc:439] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } } }
I20260806 18:39:12.622614 16448 tablet_replica.cc:442] T 8570cce8eed54cb388ad0af25ea70929 P 2cd2eba33b6f47e18c94612a200b089a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:12.623600 16484 mvcc.cc:205] Tried to move back new op lower bound from 7315626199476051968 to 7315626199299371008. Current Snapshot: MvccSnapshot[applied={T|T < 7315626199476051968}]
I20260806 18:39:12.632007 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.627410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.12.177.130:43343)
0806 18:39:12.627544 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.627549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.627563 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:12.627649 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.627652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.627718 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.627841 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:12.628211 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.629070 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.630306 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.630706 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.630818 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.631081 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.631624 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.631741 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.631798 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.631858 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:39:12.646287 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.641668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:53313 (local address 127.12.177.131:35947)
0806 18:39:12.641859 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.641866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.642148 (+ 282us) server_negotiation.cc:407] Connection header received
0806 18:39:12.642298 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.642300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.642351 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.642422 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:12.642870 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.643446 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.644816 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.645066 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.645158 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.645753 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.645847 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.645922 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.646106 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.646170 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 18:39:12.646363 16498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.641512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.12.177.130:53313)
0806 18:39:12.642026 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.642043 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.642174 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.642471 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.642474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.642483 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:12.642712 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.642719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.643592 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.643596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.644664 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.644676 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.645268 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.645272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.645418 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.645514 (+ 96us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.645949 (+ 435us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.645957 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.646032 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.646126 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":163,"threads_started":1}
I20260806 18:39:12.655303 15940 raft_consensus.cc:1261] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Refusing update from remote peer 2cd2eba33b6f47e18c94612a200b089a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:12.655413 16336 raft_consensus.cc:1261] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Refusing update from remote peer 2cd2eba33b6f47e18c94612a200b089a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:12.655882 16448 consensus_queue.cc:1035] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:12.656138 16457 consensus_queue.cc:1035] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:12.688947 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.684589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:49743 (local address 127.12.177.130:43343)
0806 18:39:12.684732 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.684739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.684754 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:12.684803 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.684812 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.684855 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.684948 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:12.685414 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.686048 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.686952 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.687439 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.687743 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.688361 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.688486 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.688572 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.688723 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.688800 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:39:12.689110 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.684338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43343 (local address 127.12.177.131:49743)
0806 18:39:12.684521 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.684539 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.684643 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.684961 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.684965 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.684972 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:12.685226 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.685235 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.686174 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.686179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.686803 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.686813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.687900 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.687905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.688119 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.688181 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:12.688601 (+ 420us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:12.688609 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.688692 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.688800 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 18:39:12.719610 15692 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:12.719875 15692 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:12.723987 15692 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Sending DeleteTablet for 3 replicas of tablet 3adb7064177a4c59a73431483dbc2d81
I20260806 18:39:12.725911 16306 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adb7064177a4c59a73431483dbc2d81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:12 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51938
I20260806 18:39:12.726500 16116 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adb7064177a4c59a73431483dbc2d81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:12 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44046
I20260806 18:39:12.727166 15907 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adb7064177a4c59a73431483dbc2d81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:12 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:43390
I20260806 18:39:12.728024 16512 tablet_replica.cc:330] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: stopping tablet replica
I20260806 18:39:12.728049 15692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 18:39:12.728528 16512 raft_consensus.cc:2229] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:12.728845 16512 raft_consensus.cc:2258] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:12.729413 16514 tablet_replica.cc:330] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: stopping tablet replica
W20260806 18:39:12.729583 15692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:12.729802 16514 raft_consensus.cc:2229] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:12.730554 16514 raft_consensus.cc:2258] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:12.732681 16512 ts_tablet_manager.cc:1905] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:12.735033 16514 ts_tablet_manager.cc:1905] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:12.738332 16116 tablet_service.cc:1467] Processing CreateTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 (DEFAULT_TABLE table=test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.738322 16306 tablet_service.cc:1467] Processing CreateTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 (DEFAULT_TABLE table=test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.738670 16116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66fbbaac09da4f07b0d7ba91203e42d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.738718 16306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66fbbaac09da4f07b0d7ba91203e42d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.741433 16438 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Bootstrap starting.
I20260806 18:39:12.742009 15907 tablet_service.cc:1467] Processing CreateTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 (DEFAULT_TABLE table=test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:12.742307 15907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66fbbaac09da4f07b0d7ba91203e42d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:12.743145 16438 tablet_bootstrap.cc:654] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.745191 16440 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Bootstrap starting.
I20260806 18:39:12.745400 16436 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Bootstrap starting.
I20260806 18:39:12.746829 16436 tablet_bootstrap.cc:654] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.747074 16440 tablet_bootstrap.cc:654] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:12.751768 16438 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: No bootstrap required, opened a new log
I20260806 18:39:12.751892 16438 ts_tablet_manager.cc:1397] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260806 18:39:12.752888 16512 ts_tablet_manager.cc:1918] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:12.752822 16438 raft_consensus.cc:348] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.753044 16512 log.cc:1196] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/3adb7064177a4c59a73431483dbc2d81
I20260806 18:39:12.753036 16438 raft_consensus.cc:374] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.753201 16438 raft_consensus.cc:729] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.753391 16438 consensus_queue.cc:260] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.753562 16512 ts_tablet_manager.cc:1939] T 3adb7064177a4c59a73431483dbc2d81 P 34dabb6789a8419d8e659d8fbb45471d: Deleting consensus metadata
I20260806 18:39:12.753734 16438 ts_tablet_manager.cc:1428] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:12.753734 16516 tablet_replica.cc:330] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: stopping tablet replica
I20260806 18:39:12.754139 16516 raft_consensus.cc:2229] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:12.754453 16516 raft_consensus.cc:2258] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:12.755110 15670 catalog_manager.cc:4841] TS 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947): tablet 3adb7064177a4c59a73431483dbc2d81 (table test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]) successfully deleted
I20260806 18:39:12.756554 16436 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: No bootstrap required, opened a new log
I20260806 18:39:12.756644 16436 ts_tablet_manager.cc:1397] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260806 18:39:12.756915 16440 tablet_bootstrap.cc:492] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: No bootstrap required, opened a new log
I20260806 18:39:12.757004 16440 ts_tablet_manager.cc:1397] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260806 18:39:12.757292 16436 raft_consensus.cc:348] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.757448 16436 raft_consensus.cc:374] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.757483 16436 raft_consensus.cc:729] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.757632 16436 consensus_queue.cc:260] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.757798 16440 raft_consensus.cc:348] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.757925 16440 raft_consensus.cc:374] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:12.757958 16440 raft_consensus.cc:729] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Initialized, Role: FOLLOWER
I20260806 18:39:12.758071 16436 ts_tablet_manager.cc:1428] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 18:39:12.758113 16440 consensus_queue.cc:260] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.758384 16440 ts_tablet_manager.cc:1428] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 18:39:12.760481 16514 ts_tablet_manager.cc:1918] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:12.760593 16514 log.cc:1196] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/3adb7064177a4c59a73431483dbc2d81
I20260806 18:39:12.760967 16514 ts_tablet_manager.cc:1939] T 3adb7064177a4c59a73431483dbc2d81 P 2cd2eba33b6f47e18c94612a200b089a: Deleting consensus metadata
I20260806 18:39:12.762370 15672 catalog_manager.cc:4841] TS 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343): tablet 3adb7064177a4c59a73431483dbc2d81 (table test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]) successfully deleted
I20260806 18:39:12.762787 16516 ts_tablet_manager.cc:1905] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:12.766325 16516 ts_tablet_manager.cc:1918] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:12.766446 16516 log.cc:1196] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/3adb7064177a4c59a73431483dbc2d81
I20260806 18:39:12.766754 16516 ts_tablet_manager.cc:1939] T 3adb7064177a4c59a73431483dbc2d81 P 0d0879e6a11844959642e9e710b5d29b: Deleting consensus metadata
I20260806 18:39:12.768213 15672 catalog_manager.cc:4841] TS 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507): tablet 3adb7064177a4c59a73431483dbc2d81 (table test-table [id=d958dc57d24c49d9be0cfc11b7fc430a]) successfully deleted
I20260806 18:39:12.938634 16452 raft_consensus.cc:482] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:12.938798 16452 raft_consensus.cc:504] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.940073 16452 leader_election.cc:288] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343), 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947)
I20260806 18:39:12.946241 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.940500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:35311 (local address 127.12.177.131:35947)
0806 18:39:12.940641 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.940649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.940931 (+ 282us) server_negotiation.cc:407] Connection header received
0806 18:39:12.941065 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.941068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.941125 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.941215 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.941663 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.942461 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.944709 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.945370 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.945507 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.945566 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.946013 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.946099 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:12.946241 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.940578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:52943 (local address 127.12.177.130:43343)
0806 18:39:12.940714 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:12.940718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:12.940901 (+ 183us) server_negotiation.cc:407] Connection header received
0806 18:39:12.941065 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:12.941068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:12.941125 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:12.941215 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:12.941659 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.942461 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.944709 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.945370 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.945507 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.945566 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:12.946013 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 18:39:12.946099 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 18:39:12.946578 16522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.940425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43343 (local address 127.12.177.129:52943)
0806 18:39:12.940784 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.940798 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.940950 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.941244 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.941247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.941274 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.941527 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.941535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.942611 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.942616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.944546 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.944561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.945648 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.945654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.945848 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.945888 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.945977 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.946138 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":198,"spinlock_wait_cycles":20736,"thread_start_us":77,"threads_started":1}
I20260806 18:39:12.946743 16521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:12.940399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.12.177.129:35311)
0806 18:39:12.940781 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:12.940808 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:12.940950 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:12.941244 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:12.941247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:12.941276 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:12.941527 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.941535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.942630 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.942633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.944546 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:12.944561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:12.945655 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:12.945658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:12.945853 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:12.945882 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:39:12.945977 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 18:39:12.946138 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":307,"spinlock_wait_cycles":32512,"thread_start_us":102,"threads_started":1}
I20260806 18:39:12.947217 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66fbbaac09da4f07b0d7ba91203e42d1" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a" is_pre_election: true
I20260806 18:39:12.947391 16124 raft_consensus.cc:2454] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 0.
I20260806 18:39:12.947359 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66fbbaac09da4f07b0d7ba91203e42d1" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d" is_pre_election: true
I20260806 18:39:12.947525 16336 raft_consensus.cc:2454] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 0.
I20260806 18:39:12.947932 15838 leader_election.cc:302] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 2cd2eba33b6f47e18c94612a200b089a, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:12.948297 16452 raft_consensus.cc:2781] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:12.948385 16452 raft_consensus.cc:482] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:12.948443 16452 raft_consensus.cc:3037] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.950184 16452 raft_consensus.cc:504] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.950626 16452 leader_election.cc:288] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 election: Requested vote from peers 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343), 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947)
I20260806 18:39:12.950987 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66fbbaac09da4f07b0d7ba91203e42d1" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d"
I20260806 18:39:12.951014 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66fbbaac09da4f07b0d7ba91203e42d1" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a"
I20260806 18:39:12.951124 16124 raft_consensus.cc:3037] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.951124 16336 raft_consensus.cc:3037] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:12.952284 16124 raft_consensus.cc:2454] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 1.
I20260806 18:39:12.952289 16336 raft_consensus.cc:2454] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 1.
I20260806 18:39:12.952700 15836 leader_election.cc:302] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:12.952929 16452 raft_consensus.cc:2781] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:12.953251 16452 raft_consensus.cc:686] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 1 LEADER]: Becoming Leader. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Running, Role: LEADER
I20260806 18:39:12.953562 16452 consensus_queue.cc:237] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:12.956318 15692 catalog_manager.cc:5495] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d0879e6a11844959642e9e710b5d29b (127.12.177.129). New cstate: current_term: 1 leader_uuid: "0d0879e6a11844959642e9e710b5d29b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } health_report { overall_health: UNKNOWN } } }
I20260806 18:39:13.011305 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:13.007525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43404 (local address 127.12.177.129:38507)
0806 18:39:13.007648 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:13.007655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:13.007671 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:13.007870 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:13.007878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:13.007939 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:13.008062 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:13.008317 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.008850 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.009733 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.009991 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.010108 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:13.010402 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:13.010891 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:13.011024 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:13.011095 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 18:39:13.011155 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 18:39:13.023402 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:13.019479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.12.177.129:46285)
0806 18:39:13.020064 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:13.020078 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:13.020280 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:13.020554 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:13.020557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:13.020564 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:13.020712 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:13.020717 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.021457 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.021460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:13.022152 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:13.022161 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.022593 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.022595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:13.022742 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:13.022792 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:13.023076 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:13.023081 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 18:39:13.023131 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 18:39:13.023197 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":259,"threads_started":1}
I20260806 18:39:13.023401 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:13.019624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:46285 (local address 127.12.177.131:35947)
0806 18:39:13.019812 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:13.019818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:13.020256 (+ 438us) server_negotiation.cc:407] Connection header received
0806 18:39:13.020377 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:13.020380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:13.020430 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:13.020526 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:13.020818 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.021330 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.022264 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.022487 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.022568 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:13.022919 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:13.022997 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:13.023052 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:13.023224 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 18:39:13.023291 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 18:39:13.030298 16336 raft_consensus.cc:1261] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Refusing update from remote peer 0d0879e6a11844959642e9e710b5d29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:13.030689 16124 raft_consensus.cc:1261] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Refusing update from remote peer 0d0879e6a11844959642e9e710b5d29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:13.031019 16523 consensus_queue.cc:1035] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:13.031219 16452 consensus_queue.cc:1035] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:13.051697 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:13.048529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:46265 (local address 127.12.177.129:38507)
0806 18:39:13.048775 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:13.048780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:13.048795 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:13.048839 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:13.048841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:13.048893 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:13.048956 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:13.049246 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.049810 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.050764 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.051051 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.051134 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:13.051344 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:13.051417 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:13.051470 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:13.051552 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 18:39:13.051594 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260806 18:39:13.051715 16418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:13.048458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38507 (local address 127.12.177.131:46265)
0806 18:39:13.048601 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:13.048615 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:13.048683 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:13.048997 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:13.049001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:13.049009 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:13.049149 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:13.049157 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.049911 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.049914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:13.050665 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:13.050675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:13.051154 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:13.051157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:13.051218 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:13.051246 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:13.051492 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:13.051496 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 18:39:13.051545 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 18:39:13.051611 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 18:39:13.052465 16485 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 18:39:14.632230 15692 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:14.632475 15692 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:14.635881 15692 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Sending DeleteTablet for 3 replicas of tablet 66fbbaac09da4f07b0d7ba91203e42d1
I20260806 18:39:14.636736 16116 tablet_service.cc:1514] Processing DeleteTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44046
I20260806 18:39:14.636808 15907 tablet_service.cc:1514] Processing DeleteTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:43390
I20260806 18:39:14.636881 16306 tablet_service.cc:1514] Processing DeleteTablet for tablet 66fbbaac09da4f07b0d7ba91203e42d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51938
I20260806 18:39:14.637331 16573 tablet_replica.cc:330] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: stopping tablet replica
I20260806 18:39:14.637395 16572 tablet_replica.cc:330] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: stopping tablet replica
I20260806 18:39:14.637517 16572 raft_consensus.cc:2229] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:14.637518 16573 raft_consensus.cc:2229] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:14.637643 16572 raft_consensus.cc:2258] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:14.637882 16573 raft_consensus.cc:2258] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:14.638162 16570 tablet_replica.cc:330] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: stopping tablet replica
I20260806 18:39:14.638309 16570 raft_consensus.cc:2229] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:14.638417 16570 raft_consensus.cc:2258] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:14.639158 16570 ts_tablet_manager.cc:1905] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.640683 16573 ts_tablet_manager.cc:1905] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.641175 16572 ts_tablet_manager.cc:1905] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.643533 16570 ts_tablet_manager.cc:1918] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 18:39:14.643639 16570 log.cc:1196] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/66fbbaac09da4f07b0d7ba91203e42d1
I20260806 18:39:14.643720 16573 ts_tablet_manager.cc:1918] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 18:39:14.643827 16573 log.cc:1196] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/66fbbaac09da4f07b0d7ba91203e42d1
I20260806 18:39:14.643934 16570 ts_tablet_manager.cc:1939] T 66fbbaac09da4f07b0d7ba91203e42d1 P 2cd2eba33b6f47e18c94612a200b089a: Deleting consensus metadata
I20260806 18:39:14.644176 16573 ts_tablet_manager.cc:1939] T 66fbbaac09da4f07b0d7ba91203e42d1 P 0d0879e6a11844959642e9e710b5d29b: Deleting consensus metadata
I20260806 18:39:14.644546 16572 ts_tablet_manager.cc:1918] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 18:39:14.644706 16572 log.cc:1196] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/66fbbaac09da4f07b0d7ba91203e42d1
I20260806 18:39:14.644915 15672 catalog_manager.cc:4841] TS 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343): tablet 66fbbaac09da4f07b0d7ba91203e42d1 (table test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]) successfully deleted
I20260806 18:39:14.645195 15672 catalog_manager.cc:4841] TS 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507): tablet 66fbbaac09da4f07b0d7ba91203e42d1 (table test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]) successfully deleted
I20260806 18:39:14.645448 16572 ts_tablet_manager.cc:1939] T 66fbbaac09da4f07b0d7ba91203e42d1 P 34dabb6789a8419d8e659d8fbb45471d: Deleting consensus metadata
I20260806 18:39:14.646546 15670 catalog_manager.cc:4841] TS 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947): tablet 66fbbaac09da4f07b0d7ba91203e42d1 (table test-table [id=fa9ab08b3dc94427bafe8e479aeb54d0]) successfully deleted
Aug 06 18:39:14 dist-test-slave-j2vl krb5kdc[15626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041554, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 18:39:14 dist-test-slave-j2vl krb5kdc[15626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041554, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:14.674364 16585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:14.664103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44842 (local address 127.12.177.190:45587)
0806 18:39:14.664478 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:14.664492 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:14.664512 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:39:14.664555 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:14.664558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:14.664601 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:14.664707 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:14.665622 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.666190 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.667077 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.667315 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.667430 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:14.670633 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:14.670637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:14.670639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:14.670672 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:14.672383 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:14.672894 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:14.672898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:14.672902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:14.672994 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:14.673293 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:14.673297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:14.673299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:14.673591 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:14.673745 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:14.674003 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 18:39:14.674154 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":135,"threads_started":1}
I20260806 18:39:14.678007 15692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:14.678463 15692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:14.684815 15907 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee (DEFAULT_TABLE table=test-table [id=a0649d68aaaf49b79ae512590310e442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.684876 16116 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee (DEFAULT_TABLE table=test-table [id=a0649d68aaaf49b79ae512590310e442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.685182 16116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee5d3ed402e44a7aa33de292f6761ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.685184 15907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee5d3ed402e44a7aa33de292f6761ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.685103 16306 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee (DEFAULT_TABLE table=test-table [id=a0649d68aaaf49b79ae512590310e442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.685446 16306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee5d3ed402e44a7aa33de292f6761ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.687997 16587 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Bootstrap starting.
I20260806 18:39:14.688338 16589 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Bootstrap starting.
I20260806 18:39:14.688428 16586 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Bootstrap starting.
I20260806 18:39:14.688959 16587 tablet_bootstrap.cc:654] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.689414 16586 tablet_bootstrap.cc:654] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.689414 16589 tablet_bootstrap.cc:654] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.690373 16587 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: No bootstrap required, opened a new log
I20260806 18:39:14.690503 16587 ts_tablet_manager.cc:1397] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:14.690883 16589 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: No bootstrap required, opened a new log
I20260806 18:39:14.691001 16589 ts_tablet_manager.cc:1397] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 18:39:14.691459 16586 tablet_bootstrap.cc:492] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: No bootstrap required, opened a new log
I20260806 18:39:14.691468 16589 raft_consensus.cc:348] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.691578 16586 ts_tablet_manager.cc:1397] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 18:39:14.691583 16589 raft_consensus.cc:374] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.691395 16587 raft_consensus.cc:348] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.691624 16589 raft_consensus.cc:729] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.691653 16587 raft_consensus.cc:374] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.691712 16587 raft_consensus.cc:729] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.691789 16589 consensus_queue.cc:260] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.691869 16587 consensus_queue.cc:260] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.692150 16586 raft_consensus.cc:348] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.692276 16586 raft_consensus.cc:374] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.692315 16586 raft_consensus.cc:729] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.692364 16587 ts_tablet_manager.cc:1428] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:14.692481 16586 consensus_queue.cc:260] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.692778 16586 ts_tablet_manager.cc:1428] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 18:39:14.692967 16589 ts_tablet_manager.cc:1428] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 18:39:14.794373 16544 raft_consensus.cc:482] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:14.794538 16544 raft_consensus.cc:504] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.794945 16544 leader_election.cc:288] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507), 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343)
I20260806 18:39:14.795536 15939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee5d3ed402e44a7aa33de292f6761ee" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b" is_pre_election: true
I20260806 18:39:14.795598 16134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee5d3ed402e44a7aa33de292f6761ee" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a" is_pre_election: true
I20260806 18:39:14.795681 15939 raft_consensus.cc:2454] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 0.
I20260806 18:39:14.795799 16134 raft_consensus.cc:2454] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 0.
I20260806 18:39:14.796110 16244 leader_election.cc:302] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:14.796325 16544 raft_consensus.cc:2781] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:14.796391 16544 raft_consensus.cc:482] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:14.796433 16544 raft_consensus.cc:3037] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.797538 16544 raft_consensus.cc:504] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.797888 16544 leader_election.cc:288] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 election: Requested vote from peers 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507), 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343)
I20260806 18:39:14.798337 15939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee5d3ed402e44a7aa33de292f6761ee" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0879e6a11844959642e9e710b5d29b"
I20260806 18:39:14.798338 16134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee5d3ed402e44a7aa33de292f6761ee" candidate_uuid: "34dabb6789a8419d8e659d8fbb45471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a"
I20260806 18:39:14.798475 15939 raft_consensus.cc:3037] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.798475 16134 raft_consensus.cc:3037] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.799713 16134 raft_consensus.cc:2454] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 1.
I20260806 18:39:14.799693 15939 raft_consensus.cc:2454] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dabb6789a8419d8e659d8fbb45471d in term 1.
I20260806 18:39:14.800051 16244 leader_election.cc:302] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:14.800236 16544 raft_consensus.cc:2781] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:14.800340 16544 raft_consensus.cc:686] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 1 LEADER]: Becoming Leader. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Running, Role: LEADER
I20260806 18:39:14.800489 16544 consensus_queue.cc:237] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.802350 15689 catalog_manager.cc:5495] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131). New cstate: current_term: 1 leader_uuid: "34dabb6789a8419d8e659d8fbb45471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:14.827271 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:14.823648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51954 (local address 127.12.177.131:35947)
0806 18:39:14.823956 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:14.823963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:14.823975 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:39:14.824017 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:14.824020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:14.824067 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:14.824147 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:14.824470 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.825108 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.826101 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.826332 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.826420 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:14.826664 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:14.826740 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:14.826794 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:14.826905 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 18:39:14.826955 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":128,"threads_started":1}
I20260806 18:39:14.837285 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:14.834060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:44419 (local address 127.12.177.131:35947)
0806 18:39:14.834202 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:14.834205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:14.834298 (+ 93us) server_negotiation.cc:407] Connection header received
0806 18:39:14.834455 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:14.834457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:14.834503 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:14.834568 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:14.834797 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.835322 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.836143 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.836360 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.836451 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:14.836743 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:14.836817 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:14.836887 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:14.837094 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 18:39:14.837159 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 18:39:14.837291 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:14.833898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35947 (local address 127.12.177.131:44419)
0806 18:39:14.834208 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:14.834222 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:14.834324 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:14.834593 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:14.834595 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:14.834601 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:14.834689 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:14.834692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.835430 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.835433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:14.836034 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:14.836043 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:14.836468 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:14.836471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:14.836551 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:14.836579 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:14.836959 (+ 380us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:14.836966 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:39:14.837038 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 18:39:14.837108 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":142,"threads_started":1}
I20260806 18:39:14.843230 16134 raft_consensus.cc:1261] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Refusing update from remote peer 34dabb6789a8419d8e659d8fbb45471d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:14.843428 15939 raft_consensus.cc:1261] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Refusing update from remote peer 34dabb6789a8419d8e659d8fbb45471d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:14.843927 16551 consensus_queue.cc:1035] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:14.844077 16475 consensus_queue.cc:1035] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:14.881464 15689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:14.881634 15689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:14.883997 15689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Sending DeleteTablet for 3 replicas of tablet 4ee5d3ed402e44a7aa33de292f6761ee
I20260806 18:39:14.884788 16116 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44046
I20260806 18:39:14.884999 15907 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:43390
I20260806 18:39:14.885059 16570 tablet_replica.cc:330] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: stopping tablet replica
I20260806 18:39:14.885214 16570 raft_consensus.cc:2229] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:14.885231 16573 tablet_replica.cc:330] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: stopping tablet replica
I20260806 18:39:14.885373 16570 raft_consensus.cc:2258] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:14.885372 16573 raft_consensus.cc:2229] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:14.885489 16573 raft_consensus.cc:2258] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:14.885809 16306 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ee5d3ed402e44a7aa33de292f6761ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:14 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51938
I20260806 18:39:14.886077 16572 tablet_replica.cc:330] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: stopping tablet replica
I20260806 18:39:14.886197 16572 raft_consensus.cc:2229] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:14.886296 16573 ts_tablet_manager.cc:1905] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.886325 15689 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 18:39:14.886545 16572 raft_consensus.cc:2258] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 18:39:14.886813 15689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:14.887789 16572 ts_tablet_manager.cc:1905] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.888038 16570 ts_tablet_manager.cc:1905] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:14.889281 16573 ts_tablet_manager.cc:1918] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:14.889397 16573 log.cc:1196] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/4ee5d3ed402e44a7aa33de292f6761ee
I20260806 18:39:14.889678 16573 ts_tablet_manager.cc:1939] T 4ee5d3ed402e44a7aa33de292f6761ee P 0d0879e6a11844959642e9e710b5d29b: Deleting consensus metadata
I20260806 18:39:14.890420 16572 ts_tablet_manager.cc:1918] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:14.890491 16572 log.cc:1196] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/4ee5d3ed402e44a7aa33de292f6761ee
I20260806 18:39:14.890533 15672 catalog_manager.cc:4841] TS 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507): tablet 4ee5d3ed402e44a7aa33de292f6761ee (table test-table [id=a0649d68aaaf49b79ae512590310e442]) successfully deleted
I20260806 18:39:14.890748 16572 ts_tablet_manager.cc:1939] T 4ee5d3ed402e44a7aa33de292f6761ee P 34dabb6789a8419d8e659d8fbb45471d: Deleting consensus metadata
I20260806 18:39:14.890928 16570 ts_tablet_manager.cc:1918] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:14.890987 16570 log.cc:1196] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/4ee5d3ed402e44a7aa33de292f6761ee
I20260806 18:39:14.891170 16570 ts_tablet_manager.cc:1939] T 4ee5d3ed402e44a7aa33de292f6761ee P 2cd2eba33b6f47e18c94612a200b089a: Deleting consensus metadata
I20260806 18:39:14.891829 15670 catalog_manager.cc:4841] TS 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947): tablet 4ee5d3ed402e44a7aa33de292f6761ee (table test-table [id=a0649d68aaaf49b79ae512590310e442]) successfully deleted
I20260806 18:39:14.892069 15672 catalog_manager.cc:4841] TS 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343): tablet 4ee5d3ed402e44a7aa33de292f6761ee (table test-table [id=a0649d68aaaf49b79ae512590310e442]) successfully deleted
I20260806 18:39:14.896664 15907 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b (DEFAULT_TABLE table=test-table [id=68a23b3b2aaa4ec3b93ec78b606103d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.896677 16116 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b (DEFAULT_TABLE table=test-table [id=68a23b3b2aaa4ec3b93ec78b606103d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.896799 16306 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b (DEFAULT_TABLE table=test-table [id=68a23b3b2aaa4ec3b93ec78b606103d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:14.897003 16116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.897006 15907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.897076 16306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:14.899520 16587 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Bootstrap starting.
I20260806 18:39:14.900602 16587 tablet_bootstrap.cc:654] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.901250 16589 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Bootstrap starting.
I20260806 18:39:14.902202 16589 tablet_bootstrap.cc:654] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.903208 16587 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: No bootstrap required, opened a new log
I20260806 18:39:14.903326 16587 ts_tablet_manager.cc:1397] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 18:39:14.903720 16587 raft_consensus.cc:348] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.903855 16587 raft_consensus.cc:374] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.903900 16587 raft_consensus.cc:729] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd2eba33b6f47e18c94612a200b089a, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.904040 16587 consensus_queue.cc:260] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.904342 16587 ts_tablet_manager.cc:1428] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:14.904855 16589 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: No bootstrap required, opened a new log
I20260806 18:39:14.904974 16589 ts_tablet_manager.cc:1397] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 18:39:14.905395 16589 raft_consensus.cc:348] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.905565 16589 raft_consensus.cc:374] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.905608 16589 raft_consensus.cc:729] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dabb6789a8419d8e659d8fbb45471d, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.905763 16589 consensus_queue.cc:260] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.906054 16589 ts_tablet_manager.cc:1428] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 18:39:14.906417 16586 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: Bootstrap starting.
I20260806 18:39:14.907426 16586 tablet_bootstrap.cc:654] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:14.908730 16586 tablet_bootstrap.cc:492] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: No bootstrap required, opened a new log
I20260806 18:39:14.908842 16586 ts_tablet_manager.cc:1397] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 18:39:14.909296 16586 raft_consensus.cc:348] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.909454 16586 raft_consensus.cc:374] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:14.909492 16586 raft_consensus.cc:729] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Initialized, Role: FOLLOWER
I20260806 18:39:14.909602 16586 consensus_queue.cc:260] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.910362 16586 ts_tablet_manager.cc:1428] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:14.975041 16562 raft_consensus.cc:482] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:14.975188 16562 raft_consensus.cc:504] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.975733 16562 leader_election.cc:288] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343), 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947)
I20260806 18:39:14.976197 16134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4c07ef7f264b6086c2bb3bddc97e7b" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a" is_pre_election: true
I20260806 18:39:14.976222 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4c07ef7f264b6086c2bb3bddc97e7b" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d" is_pre_election: true
I20260806 18:39:14.976361 16134 raft_consensus.cc:2454] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 0.
I20260806 18:39:14.976385 16336 raft_consensus.cc:2454] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 0.
I20260806 18:39:14.976747 15836 leader_election.cc:302] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:14.976939 16562 raft_consensus.cc:2781] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:14.977020 16562 raft_consensus.cc:482] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:14.977074 16562 raft_consensus.cc:3037] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.978245 16562 raft_consensus.cc:504] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.978647 16562 leader_election.cc:288] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 election: Requested vote from peers 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343), 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947)
I20260806 18:39:14.979038 16134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4c07ef7f264b6086c2bb3bddc97e7b" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd2eba33b6f47e18c94612a200b089a"
I20260806 18:39:14.979071 16336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4c07ef7f264b6086c2bb3bddc97e7b" candidate_uuid: "0d0879e6a11844959642e9e710b5d29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34dabb6789a8419d8e659d8fbb45471d"
I20260806 18:39:14.979202 16336 raft_consensus.cc:3037] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.979208 16134 raft_consensus.cc:3037] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:14.980340 16134 raft_consensus.cc:2454] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 1.
I20260806 18:39:14.980441 16336 raft_consensus.cc:2454] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d0879e6a11844959642e9e710b5d29b in term 1.
I20260806 18:39:14.980747 15836 leader_election.cc:302] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0879e6a11844959642e9e710b5d29b, 34dabb6789a8419d8e659d8fbb45471d; no voters:
I20260806 18:39:14.980947 16562 raft_consensus.cc:2781] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:14.981042 16562 raft_consensus.cc:686] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 1 LEADER]: Becoming Leader. State: Replica: 0d0879e6a11844959642e9e710b5d29b, State: Running, Role: LEADER
I20260806 18:39:14.981199 16562 consensus_queue.cc:237] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } }
I20260806 18:39:14.983033 15689 catalog_manager.cc:5495] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d0879e6a11844959642e9e710b5d29b (127.12.177.129). New cstate: current_term: 1 leader_uuid: "0d0879e6a11844959642e9e710b5d29b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0879e6a11844959642e9e710b5d29b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 } health_report { overall_health: UNKNOWN } } }
I20260806 18:39:15.016230 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:15.012692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43416 (local address 127.12.177.129:38507)
0806 18:39:15.013067 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:15.013076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:15.013092 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:15.013144 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:15.013146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:15.013188 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:15.013282 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:15.013656 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:15.014278 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:15.015120 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:15.015368 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:15.015479 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:15.015761 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:15.015846 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:15.015928 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:15.016025 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 18:39:15.016079 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":133,"threads_started":1}
I20260806 18:39:15.024887 16336 raft_consensus.cc:1261] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Refusing update from remote peer 0d0879e6a11844959642e9e710b5d29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:15.025434 16562 consensus_queue.cc:1035] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34dabb6789a8419d8e659d8fbb45471d" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:15.025517 16134 raft_consensus.cc:1261] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Refusing update from remote peer 0d0879e6a11844959642e9e710b5d29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:15.025970 16562 consensus_queue.cc:1035] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd2eba33b6f47e18c94612a200b089a" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 18:39:15.042963 16548 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 18:39:16.607896 15689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:16.608069 15689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:16.610785 15689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44f710d9ac364def9137d8440193f4c1: Sending DeleteTablet for 3 replicas of tablet 9d4c07ef7f264b6086c2bb3bddc97e7b
I20260806 18:39:16.611472 15907 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:16 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:43390
I20260806 18:39:16.611554 16306 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:16 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51938
I20260806 18:39:16.611567 16116 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:16 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44046
I20260806 18:39:16.611876 16656 tablet_replica.cc:330] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b: stopping tablet replica
I20260806 18:39:16.611984 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15809
I20260806 18:39:16.612027 16656 raft_consensus.cc:2229] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 0d0879e6a11844959642e9e710b5d29b [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:16.612030 16660 tablet_replica.cc:330] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: stopping tablet replica
I20260806 18:39:16.629688 16660 raft_consensus.cc:2229] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:16.629943 16660 raft_consensus.cc:2258] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:16.630527 16657 tablet_replica.cc:330] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: stopping tablet replica
I20260806 18:39:16.630712 16657 raft_consensus.cc:2229] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:16.630834 16660 ts_tablet_manager.cc:1905] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:16.630862 16657 raft_consensus.cc:2258] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:16.631640 16657 ts_tablet_manager.cc:1905] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:16.633282 16660 ts_tablet_manager.cc:1918] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 18:39:16.633427 16660 log.cc:1196] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/9d4c07ef7f264b6086c2bb3bddc97e7b
I20260806 18:39:16.633688 16660 ts_tablet_manager.cc:1939] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 2cd2eba33b6f47e18c94612a200b089a: Deleting consensus metadata
I20260806 18:39:16.634514 15672 catalog_manager.cc:4841] TS 2cd2eba33b6f47e18c94612a200b089a (127.12.177.130:43343): tablet 9d4c07ef7f264b6086c2bb3bddc97e7b (table test-table [id=68a23b3b2aaa4ec3b93ec78b606103d5]) successfully deleted
I20260806 18:39:16.635278 16657 ts_tablet_manager.cc:1918] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 18:39:16.635373 16657 log.cc:1196] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/9d4c07ef7f264b6086c2bb3bddc97e7b
I20260806 18:39:16.635661 16657 ts_tablet_manager.cc:1939] T 9d4c07ef7f264b6086c2bb3bddc97e7b P 34dabb6789a8419d8e659d8fbb45471d: Deleting consensus metadata
I20260806 18:39:16.636515 15670 catalog_manager.cc:4841] TS 34dabb6789a8419d8e659d8fbb45471d (127.12.177.131:35947): tablet 9d4c07ef7f264b6086c2bb3bddc97e7b (table test-table [id=68a23b3b2aaa4ec3b93ec78b606103d5]) successfully deleted
W20260806 18:39:16.639004 15672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:38507 (error 108)
I20260806 18:39:16.639060 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 16021
I20260806 18:39:16.643134 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:16.642562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:38507 (local address 127.0.0.1:55456)
0806 18:39:16.642888 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:16.642987 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:38507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":109,"threads_started":1}
W20260806 18:39:16.643467 15672 catalog_manager.cc:4584] TS 0d0879e6a11844959642e9e710b5d29b (127.12.177.129:38507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d4c07ef7f264b6086c2bb3bddc97e7b: Network error: Client connection negotiation failed: client connection to 127.12.177.129:38507: connect: Connection refused (error 111)
I20260806 18:39:16.652741 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 16217
I20260806 18:39:16.664305 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15644
2026-08-06T18:39:16Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6881 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:16 dist-test-slave-j2vl krb5kdc[16667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:16 dist-test-slave-j2vl krb5kdc[16667](info): set up 2 sockets
Aug 06 18:39:16 dist-test-slave-j2vl krb5kdc[16667](info): commencing operation
krb5kdc: starting...
W20260806 18:39:17.964205 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:18.109658 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:42765
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:18.238859 16690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:18.239172 16690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:18.239216 16690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:18.243360 16690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:18.243443 16690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:18.243464 16690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:18.243482 16690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:18.243498 16690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:18.249125 16690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:42765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:18.250432 16690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:18.251528 16690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:18.262446 16696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:18.262476 16700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.262501 16690 server_base.cc:1034] running on GCE node
W20260806 18:39:18.262446 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.263988 16690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:18.265439 16690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:18.266646 16690 hybrid_clock.cc:648] HybridClock initialized: now 1786041558266614 us; error 51 us; skew 500 ppm
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:18.269799 16690 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:18.270864 16690 webserver.cc:460] Webserver started at http://127.12.177.190:42835/ using document root <none> and password file <none>
I20260806 18:39:18.271492 16690 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:18.271586 16690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:18.271844 16690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:18.274194 16690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "09dbb982903e4842bda286cc46506c60"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "0b81284e4c2def87bb1fb4ebd29df6bb"
server_key_iv: "476eed255cb713e95e833b79c887947a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.274852 16690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "09dbb982903e4842bda286cc46506c60"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "0b81284e4c2def87bb1fb4ebd29df6bb"
server_key_iv: "476eed255cb713e95e833b79c887947a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.279560 16690 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:18.282524 16712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.284323 16690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:18.284514 16690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "09dbb982903e4842bda286cc46506c60"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "0b81284e4c2def87bb1fb4ebd29df6bb"
server_key_iv: "476eed255cb713e95e833b79c887947a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.284662 16690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:18.303166 16690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:18.306723 16690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:18.306977 16690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:18.314972 16690 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:42765
I20260806 18:39:18.314994 16795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:42765 every 8 connection(s)
I20260806 18:39:18.316046 16690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:18.318136 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 16690
I20260806 18:39:18.318238 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:18.318538 12998 external_mini_cluster.cc:1428] Setting key 21ab02646607c5ad91359ec1f8b7dc91
I20260806 18:39:18.319370 16796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:18.325623 16796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60: Bootstrap starting.
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:18.328625 16796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:18.329559 16796 log.cc:824] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:18.332285 16796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60: No bootstrap required, opened a new log
I20260806 18:39:18.334460 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:18.320095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39092 (local address 127.12.177.190:42765)
0806 18:39:18.320588 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:18.320604 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:18.320640 (+ 36us) server_negotiation.cc:407] Connection header received
0806 18:39:18.321311 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:18.321327 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:18.321758 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:18.322103 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:18.322936 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.323956 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.324830 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.325325 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.325564 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:18.329040 (+ 3476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:18.329046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:18.329062 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:18.329095 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:18.331086 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.331644 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.331649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.331653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.331767 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.332108 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.332110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.332111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.332587 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:18.332730 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:18.333093 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 18:39:18.333413 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":173,"threads_started":1}
I20260806 18:39:18.336069 16796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } }
I20260806 18:39:18.336354 16796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:18.336422 16796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09dbb982903e4842bda286cc46506c60, State: Initialized, Role: FOLLOWER
I20260806 18:39:18.336858 16796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } }
I20260806 18:39:18.337030 16796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:18.337113 16796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:18.337239 16796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:18.338276 16796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } }
I20260806 18:39:18.338647 16796 leader_election.cc:302] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09dbb982903e4842bda286cc46506c60; no voters:
I20260806 18:39:18.338996 16796 leader_election.cc:288] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:18.339203 16802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:18.339555 16802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [term 1 LEADER]: Becoming Leader. State: Replica: 09dbb982903e4842bda286cc46506c60, State: Running, Role: LEADER
I20260806 18:39:18.339869 16802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } }
I20260806 18:39:18.340320 16796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:18.341673 16806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09dbb982903e4842bda286cc46506c60. Latest consensus state: current_term: 1 leader_uuid: "09dbb982903e4842bda286cc46506c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } } }
I20260806 18:39:18.341817 16806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:18.342157 16805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09dbb982903e4842bda286cc46506c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09dbb982903e4842bda286cc46506c60" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 42765 } } }
I20260806 18:39:18.342247 16805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:18.343221 16820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:18.346210 16820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:18.352452 16820 catalog_manager.cc:1347] Generated new cluster ID: 28616548aca1436a878ebd52b73c747e
I20260806 18:39:18.352557 16820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:18.369539 16820 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:18.370656 16820 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:18.380136 16820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09dbb982903e4842bda286cc46506c60: Generated new TSK 0
I20260806 18:39:18.381150 16820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:18.421797 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:18.550532 16835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:18.550806 16835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:18.550850 16835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:18.554996 16835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:18.555073 16835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:18.555164 16835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:18.560751 16835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:18.562009 16835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:18.563130 16835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:18.573733 16846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:18.573756 16844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.573942 16835 server_base.cc:1034] running on GCE node
W20260806 18:39:18.573825 16849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.574532 16835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:18.575341 16835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:18.576561 16835 hybrid_clock.cc:648] HybridClock initialized: now 1786041558576523 us; error 54 us; skew 500 ppm
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:18.579730 16835 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:18.580850 16835 webserver.cc:460] Webserver started at http://127.12.177.129:36255/ using document root <none> and password file <none>
I20260806 18:39:18.581519 16835 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:18.581616 16835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:18.581868 16835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:18.584088 16835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "a627401d1c1a429e85192d7bef41c70e"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "724d48277ad369fd542a59e807a83886"
server_key_iv: "72939ba5d17fcde0b4048e80bb4da3d4"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.584725 16835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "a627401d1c1a429e85192d7bef41c70e"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "724d48277ad369fd542a59e807a83886"
server_key_iv: "72939ba5d17fcde0b4048e80bb4da3d4"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.588945 16835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:18.591847 16859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.593477 16835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:18.593636 16835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "a627401d1c1a429e85192d7bef41c70e"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "724d48277ad369fd542a59e807a83886"
server_key_iv: "72939ba5d17fcde0b4048e80bb4da3d4"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.593770 16835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:18.657944 16835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:18.662091 16835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:18.662348 16835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:18.663031 16835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:18.663959 16835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:18.664032 16835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.664108 16835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:18.664160 16835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.674273 16835 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:45343
I20260806 18:39:18.674331 17023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:45343 every 8 connection(s)
I20260806 18:39:18.675324 16835 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:18.681736 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 16835
I20260806 18:39:18.681866 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:18.682202 12998 external_mini_cluster.cc:1428] Setting key 5867620d50f943d77e0073c22d8212ac
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:18.693686 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:18.677514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:34399 (local address 127.12.177.190:42765)
0806 18:39:18.677676 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:18.677681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:18.678920 (+ 1239us) server_negotiation.cc:407] Connection header received
0806 18:39:18.679835 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:18.679838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:18.679920 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:18.680009 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:18.681399 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.682092 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.683804 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.684149 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.684241 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:18.688189 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:18.688197 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:18.688203 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:18.688245 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:18.690411 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.691482 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.691489 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.691492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.691611 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.692097 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.692103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.692108 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.692425 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:18.692554 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:18.693260 (+ 706us) server_negotiation.cc:299] Negotiation successful
0806 18:39:18.693470 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 18:39:18.694587 17027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:18.677964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42765 (local address 127.12.177.129:34399)
0806 18:39:18.678700 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:18.678785 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:18.679601 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:18.680224 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:18.680232 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:18.680639 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:18.681193 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:18.681208 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.682372 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.682379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:18.683657 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:18.683674 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.684353 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.684359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:18.684632 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:18.685459 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:18.685489 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:18.687855 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:18.690765 (+ 2910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:18.690773 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:18.690795 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:18.691334 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:18.691750 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:18.691753 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:18.691755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:18.691974 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:18.692609 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:18.692616 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:18.692965 (+ 349us) client_negotiation.cc:769] Sending connection context
0806 18:39:18.693159 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 18:39:18.693571 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:18.696457 17024 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42765
I20260806 18:39:18.696779 17024 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:18.697440 17024 heartbeater.cc:511] Master 127.12.177.190:42765 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:18.699415 16735 ts_manager.cc:194] Registered new tserver with Master: a627401d1c1a429e85192d7bef41c70e (127.12.177.129:45343)
I20260806 18:39:18.701166 16735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:34399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:18.721586 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:18.848510 17031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:18.848819 17031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:18.848865 17031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:18.853190 17031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:18.853281 17031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:18.853447 17031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:18.859438 17031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:18.860754 17031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:18.861917 17031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:18.872618 17036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:18.872632 17039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.872740 17031 server_base.cc:1034] running on GCE node
W20260806 18:39:18.872627 17037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:18.873517 17031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:18.874182 17031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:18.875356 17031 hybrid_clock.cc:648] HybridClock initialized: now 1786041558875316 us; error 51 us; skew 500 ppm
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:18.878562 17031 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:18.879634 17031 webserver.cc:460] Webserver started at http://127.12.177.130:40263/ using document root <none> and password file <none>
I20260806 18:39:18.880424 17031 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:18.880524 17031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:18.880815 17031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:18.883991 17031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "419286e543b24f0cb65673f06143b6fe"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "df782dc2894bd5c919e67f490d1f0f42"
server_key_iv: "2d97cb0b8764aaeb8abfd15b7ba2350a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.884788 17031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "419286e543b24f0cb65673f06143b6fe"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "df782dc2894bd5c919e67f490d1f0f42"
server_key_iv: "2d97cb0b8764aaeb8abfd15b7ba2350a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.890620 17031 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 18:39:18.894043 17051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.895920 17031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:18.896075 17031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "419286e543b24f0cb65673f06143b6fe"
format_stamp: "Formatted at 2026-08-06 18:39:18 on dist-test-slave-j2vl"
server_key: "df782dc2894bd5c919e67f490d1f0f42"
server_key_iv: "2d97cb0b8764aaeb8abfd15b7ba2350a"
server_key_version: "encryptionkey@0"
I20260806 18:39:18.896250 17031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:18.914062 17031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:18.917030 17031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:18.917210 17031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:18.917897 17031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:18.918776 17031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:18.918828 17031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.918872 17031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:18.918888 17031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:18.928696 17031 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:43875
I20260806 18:39:18.928717 17226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:43875 every 8 connection(s)
I20260806 18:39:18.929853 17031 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:18.931466 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17031
I20260806 18:39:18.931595 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:18.931911 12998 external_mini_cluster.cc:1428] Setting key f55207e8a361ffe333cc556327352568
Aug 06 18:39:18 dist-test-slave-j2vl krb5kdc[16667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041558, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:18.946637 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:18.933986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:40073 (local address 127.12.177.190:42765)
0806 18:39:18.934143 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:18.934147 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:18.934164 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:39:18.934845 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:18.934848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:18.934904 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:18.935010 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:18.936462 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.937011 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.938482 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.938724 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.938857 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:18.942057 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:18.942062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:18.942065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:18.942103 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:18.943837 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.944418 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.944452 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.944456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.944566 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:18.944989 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:18.944992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:18.944993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:18.945224 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:18.945324 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:18.946240 (+ 916us) server_negotiation.cc:299] Negotiation successful
0806 18:39:18.946383 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:18.947695 17230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:18.932803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42765 (local address 127.12.177.130:40073)
0806 18:39:18.933619 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:18.933677 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:18.934603 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:18.935191 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:18.935198 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:18.935720 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:18.936273 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:18.936287 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.937156 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.937159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:18.938318 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:18.938329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:18.938910 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:18.938914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:18.939095 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:18.939980 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:18.940011 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:18.941787 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:18.943973 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:18.943980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:18.944002 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:18.944308 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:18.944676 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:18.944679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:18.944680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:18.944853 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:18.945450 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:18.945457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:18.945758 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 18:39:18.946176 (+ 418us) client_negotiation.cc:240] Negotiation successful
0806 18:39:18.946565 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":141,"threads_started":1}
I20260806 18:39:18.949434 17227 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42765
I20260806 18:39:18.949708 17227 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:18.950289 17227 heartbeater.cc:511] Master 127.12.177.190:42765 requested a full tablet report, sending...
I20260806 18:39:18.951498 16735 ts_manager.cc:194] Registered new tserver with Master: 419286e543b24f0cb65673f06143b6fe (127.12.177.130:43875)
I20260806 18:39:18.952103 16735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:40073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:18.965168 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:19.087395 17233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:19.087705 17233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:19.087752 17233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:19.092058 17233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:19.092133 17233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:19.092197 17233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:19.097883 17233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:19.099128 17233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:19.100198 17233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:19.111001 17244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:19.111002 17242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:19.111002 17239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:19.111661 17233 server_base.cc:1034] running on GCE node
I20260806 18:39:19.112197 17233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:19.112962 17233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:19.114229 17233 hybrid_clock.cc:648] HybridClock initialized: now 1786041559114211 us; error 34 us; skew 500 ppm
Aug 06 18:39:19 dist-test-slave-j2vl krb5kdc[16667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041559, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:19.117532 17233 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:19.118620 17233 webserver.cc:460] Webserver started at http://127.12.177.131:42275/ using document root <none> and password file <none>
I20260806 18:39:19.119262 17233 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:19.119369 17233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:19.119624 17233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:19.122090 17233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "ab94447bce134ae18638512a1330c62b"
format_stamp: "Formatted at 2026-08-06 18:39:19 on dist-test-slave-j2vl"
server_key: "688904e04cd06c8469f8357d7c001cc7"
server_key_iv: "e4ab1ed02304ccd2c718e9fe20f23192"
server_key_version: "encryptionkey@0"
I20260806 18:39:19.122797 17233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "ab94447bce134ae18638512a1330c62b"
format_stamp: "Formatted at 2026-08-06 18:39:19 on dist-test-slave-j2vl"
server_key: "688904e04cd06c8469f8357d7c001cc7"
server_key_iv: "e4ab1ed02304ccd2c718e9fe20f23192"
server_key_version: "encryptionkey@0"
I20260806 18:39:19.127132 17233 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:19.130101 17255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:19.131637 17233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:19.131829 17233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "ab94447bce134ae18638512a1330c62b"
format_stamp: "Formatted at 2026-08-06 18:39:19 on dist-test-slave-j2vl"
server_key: "688904e04cd06c8469f8357d7c001cc7"
server_key_iv: "e4ab1ed02304ccd2c718e9fe20f23192"
server_key_version: "encryptionkey@0"
I20260806 18:39:19.131986 17233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:19.165004 17233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:19.168447 17233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:19.168691 17233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:19.169440 17233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:19.170476 17233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:19.170568 17233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:19.170639 17233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:19.170670 17233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:19.180800 17233 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:33863
I20260806 18:39:19.180822 17416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:33863 every 8 connection(s)
I20260806 18:39:19.181955 17233 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:19.184257 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17233
I20260806 18:39:19.184383 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:19.184682 12998 external_mini_cluster.cc:1428] Setting key 42a32eca66fa46ae43d21f57562a36ed
Aug 06 18:39:19 dist-test-slave-j2vl krb5kdc[16667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041559, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:19.196791 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:19.183980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:55881 (local address 127.12.177.190:42765)
0806 18:39:19.184158 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:19.184163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:19.185494 (+ 1331us) server_negotiation.cc:407] Connection header received
0806 18:39:19.186396 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:19.186399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:19.186464 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:19.186556 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:19.187987 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:19.188531 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:19.189930 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:19.190150 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:19.190233 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:19.192863 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:19.192866 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:19.192869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:19.192897 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:19.194423 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:19.195227 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:19.195230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:19.195232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:19.195354 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:19.195693 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:19.195695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:19.195697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:19.195905 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:19.195988 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:19.196543 (+ 555us) server_negotiation.cc:299] Negotiation successful
0806 18:39:19.196659 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:39:19.197880 17423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:19.184492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:42765 (local address 127.12.177.131:55881)
0806 18:39:19.185300 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:19.185387 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:19.186196 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:19.186828 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:19.186839 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:19.187308 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:19.187848 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:19.187862 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:19.188664 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:19.188668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:19.189821 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:19.189833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:19.190298 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:19.190301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:19.190456 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:19.191040 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:19.191057 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:19.192670 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:19.194768 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:19.194774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:19.194790 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:19.195103 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:19.195452 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:19.195454 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:19.195456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:19.195602 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:19.196014 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:19.196020 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:19.196286 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 18:39:19.196459 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 18:39:19.196748 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":157,"threads_started":1}
I20260806 18:39:19.199118 17417 heartbeater.cc:347] Connected to a master server at 127.12.177.190:42765
I20260806 18:39:19.199376 17417 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:19.199980 17417 heartbeater.cc:511] Master 127.12.177.190:42765 requested a full tablet report, sending...
I20260806 18:39:19.201122 16735 ts_manager.cc:194] Registered new tserver with Master: ab94447bce134ae18638512a1330c62b (127.12.177.131:33863)
I20260806 18:39:19.201810 16735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:55881
I20260806 18:39:19.211714 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 18:39:19.229185 16800 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:19.227600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.12.177.190:42765)
0806 18:39:19.227823 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:19.227827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:19.227937 (+ 110us) server_negotiation.cc:407] Connection header received
0806 18:39:19.228069 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:19.228071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:19.228118 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:19.228192 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:19.229034 (+ 842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39106: BlockingRecv error: recv got EOF from 127.0.0.1:39106 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 18:39:19.230334 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 16835
I20260806 18:39:19.261787 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17031
I20260806 18:39:19.273881 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17233
I20260806 18:39:19.288556 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 16690
2026-08-06T18:39:19Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2617 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:19 dist-test-slave-j2vl krb5kdc[17439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:19 dist-test-slave-j2vl krb5kdc[17439](info): set up 2 sockets
Aug 06 18:39:19 dist-test-slave-j2vl krb5kdc[17439](info): commencing operation
krb5kdc: starting...
W20260806 18:39:20.568470 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:20 dist-test-slave-j2vl krb5kdc[17439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:20.713894 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:40455
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:40455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:20.840348 17459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:20.840754 17459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:20.840847 17459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:20.845322 17459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:20.845489 17459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:20.845559 17459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:20.845620 17459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:20.845680 17459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:20.852022 17459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:40455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:40455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:20.853363 17459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:20.854859 17459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:20.865990 17470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:20.865931 17474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:20.866123 17459 server_base.cc:1034] running on GCE node
W20260806 18:39:20.866398 17471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:20.867161 17459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:20.868559 17459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:20.870046 17459 hybrid_clock.cc:648] HybridClock initialized: now 1786041560870036 us; error 59 us; skew 500 ppm
Aug 06 18:39:20 dist-test-slave-j2vl krb5kdc[17439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041560, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:20.873661 17459 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:20.874889 17459 webserver.cc:460] Webserver started at http://127.12.177.190:37305/ using document root <none> and password file <none>
I20260806 18:39:20.875566 17459 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:20.875672 17459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:20.875939 17459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:20.878396 17459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "8fdd300c518d4ed184509ab2e363fc15"
format_stamp: "Formatted at 2026-08-06 18:39:20 on dist-test-slave-j2vl"
server_key: "80a35569df0f46b15b07409f5b12dcdf"
server_key_iv: "fa5b9402dfd650b627e3fc30dd11aafd"
server_key_version: "encryptionkey@0"
I20260806 18:39:20.879083 17459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "8fdd300c518d4ed184509ab2e363fc15"
format_stamp: "Formatted at 2026-08-06 18:39:20 on dist-test-slave-j2vl"
server_key: "80a35569df0f46b15b07409f5b12dcdf"
server_key_iv: "fa5b9402dfd650b627e3fc30dd11aafd"
server_key_version: "encryptionkey@0"
I20260806 18:39:20.883520 17459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:20.886559 17484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:20.888139 17459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:20.888360 17459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "8fdd300c518d4ed184509ab2e363fc15"
format_stamp: "Formatted at 2026-08-06 18:39:20 on dist-test-slave-j2vl"
server_key: "80a35569df0f46b15b07409f5b12dcdf"
server_key_iv: "fa5b9402dfd650b627e3fc30dd11aafd"
server_key_version: "encryptionkey@0"
I20260806 18:39:20.888520 17459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:20.903668 17459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:20.907714 17459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:20.907971 17459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:20.916947 17459 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:40455
I20260806 18:39:20.917268 17562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:40455 every 8 connection(s)
I20260806 18:39:20.918349 17459 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:20.921912 17564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:20.923199 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17459
I20260806 18:39:20.923336 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:20.923645 12998 external_mini_cluster.cc:1428] Setting key aa897f43f5256c9b712d6ab57138f6f5
I20260806 18:39:20.929390 17564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15: Bootstrap starting.
I20260806 18:39:20.931957 17564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:20.932942 17564 log.cc:824] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:39:20 dist-test-slave-j2vl krb5kdc[17439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:20.935824 17564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15: No bootstrap required, opened a new log
I20260806 18:39:20.941057 17564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } }
I20260806 18:39:20.941318 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:20.925636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37780 (local address 127.12.177.190:40455)
0806 18:39:20.926216 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:20.926248 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:20.926294 (+ 46us) server_negotiation.cc:407] Connection header received
0806 18:39:20.927251 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:20.927274 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:20.927662 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:20.928053 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:20.929009 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:20.930165 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:20.931122 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:20.931655 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:20.931853 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:20.935292 (+ 3439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:20.935299 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:20.935318 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:20.935353 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:20.937621 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:20.938198 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:20.938207 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:20.938215 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:20.938399 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:20.938714 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:20.938719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:20.938720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:20.939327 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:20.939550 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:20.939855 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 18:39:20.940210 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":172,"threads_started":1}
I20260806 18:39:20.941411 17564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:20.941461 17564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdd300c518d4ed184509ab2e363fc15, State: Initialized, Role: FOLLOWER
I20260806 18:39:20.941994 17564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } }
I20260806 18:39:20.942173 17564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:20.942286 17564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:20.942392 17564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:20.943615 17564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } }
I20260806 18:39:20.943995 17564 leader_election.cc:302] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fdd300c518d4ed184509ab2e363fc15; no voters:
I20260806 18:39:20.944437 17564 leader_election.cc:288] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:20.944526 17572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:20.944741 17572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdd300c518d4ed184509ab2e363fc15, State: Running, Role: LEADER
I20260806 18:39:20.944864 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:39:20.945068 17572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } }
I20260806 18:39:20.945966 17564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:20.946419 17574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fdd300c518d4ed184509ab2e363fc15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } } }
I20260806 18:39:20.946564 17574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:20.946908 17573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fdd300c518d4ed184509ab2e363fc15. Latest consensus state: current_term: 1 leader_uuid: "8fdd300c518d4ed184509ab2e363fc15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fdd300c518d4ed184509ab2e363fc15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40455 } } }
I20260806 18:39:20.947083 17573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:20.948630 17576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:20.951735 17576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:20.960080 17576 catalog_manager.cc:1347] Generated new cluster ID: d669f258543242cc8655ffc9fb0248f1
I20260806 18:39:20.960295 17576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:20.968505 17576 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:20.969791 17576 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:20.971650 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:20.965632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37794 (local address 127.12.177.190:40455)
0806 18:39:20.965764 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:20.965769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:20.966093 (+ 324us) server_negotiation.cc:407] Connection header received
0806 18:39:20.966257 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:20.966261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:20.966322 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:20.966420 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:20.967105 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:20.967722 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:20.968954 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:20.969379 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:20.969492 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:20.970489 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:20.970493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:20.970497 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:20.971107 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:20.971144 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:20.971165 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:20.971273 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:20.971402 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 18:39:20.971492 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:20.976732 17576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fdd300c518d4ed184509ab2e363fc15: Generated new TSK 0
I20260806 18:39:20.977604 17576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:39:20.983139 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17459
2026-08-06T18:39:20Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1697 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:21 dist-test-slave-j2vl krb5kdc[17611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:21 dist-test-slave-j2vl krb5kdc[17611](info): set up 2 sockets
Aug 06 18:39:21 dist-test-slave-j2vl krb5kdc[17611](info): commencing operation
krb5kdc: starting...
W20260806 18:39:22.260962 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:22 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:22.405184 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46819
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:46819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:22.531929 17625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:22.532292 17625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:22.532385 17625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:22.536790 17625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:22.536929 17625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:22.536966 17625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:22.537009 17625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:22.537045 17625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:22.542824 17625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:46819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:22.544104 17625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:22.545210 17625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:22.554333 17631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:22.554333 17632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:22.554327 17634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:22.554709 17625 server_base.cc:1034] running on GCE node
I20260806 18:39:22.555390 17625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:22.556524 17625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:22.557725 17625 hybrid_clock.cc:648] HybridClock initialized: now 1786041562557697 us; error 40 us; skew 500 ppm
Aug 06 18:39:22 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041562, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:22.565989 17625 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:22.567291 17625 webserver.cc:460] Webserver started at http://127.12.177.190:39555/ using document root <none> and password file <none>
I20260806 18:39:22.567961 17625 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:22.568070 17625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:22.568332 17625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:22.570737 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "53930e27086b4fc09342b4bddbd14a28"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "70febd7b80dc41d36551e9e183973b89"
server_key_iv: "3465e7734d9cfae5edb1705d8caf880c"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.571420 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "53930e27086b4fc09342b4bddbd14a28"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "70febd7b80dc41d36551e9e183973b89"
server_key_iv: "3465e7734d9cfae5edb1705d8caf880c"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.576020 17625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:22.579200 17645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:22.580633 17625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:22.580821 17625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "53930e27086b4fc09342b4bddbd14a28"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "70febd7b80dc41d36551e9e183973b89"
server_key_iv: "3465e7734d9cfae5edb1705d8caf880c"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.580977 17625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:22.595255 17625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:22.599061 17625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:22.599311 17625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:22.607553 17625 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:46819
I20260806 18:39:22.607863 17715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:46819 every 8 connection(s)
I20260806 18:39:22.608731 17625 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:22.612061 17716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:22.613876 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17625
I20260806 18:39:22.614058 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:22.614357 12998 external_mini_cluster.cc:1428] Setting key 5ad49751aaf66bf94f7bc3cba9bd11a3
I20260806 18:39:22.619959 17716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28: Bootstrap starting.
I20260806 18:39:22.623131 17716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:22.624284 17716 log.cc:824] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:39:22 dist-test-slave-j2vl krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:22.626993 17716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28: No bootstrap required, opened a new log
I20260806 18:39:22.631840 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:22.616117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35426 (local address 127.12.177.190:46819)
0806 18:39:22.616620 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:22.616640 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:22.616694 (+ 54us) server_negotiation.cc:407] Connection header received
0806 18:39:22.617477 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:22.617498 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:22.617859 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:22.618174 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:22.619236 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.620453 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.621725 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.622308 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.622447 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:22.625937 (+ 3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:22.625944 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:22.625963 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:22.625996 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:22.628298 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:22.628933 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:22.628939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:22.628945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:22.629071 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:22.629450 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:22.629453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:22.629455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:22.629958 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:22.630122 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:22.630505 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 18:39:22.630910 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":181,"threads_started":1}
I20260806 18:39:22.631649 17716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } }
I20260806 18:39:22.632241 17716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:22.632339 17716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53930e27086b4fc09342b4bddbd14a28, State: Initialized, Role: FOLLOWER
I20260806 18:39:22.632853 17716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } }
I20260806 18:39:22.633033 17716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:22.633127 17716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:22.633234 17716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:22.634392 17716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } }
I20260806 18:39:22.634780 17716 leader_election.cc:302] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53930e27086b4fc09342b4bddbd14a28; no voters:
I20260806 18:39:22.635113 17716 leader_election.cc:288] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:22.635301 17727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:22.635557 17727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [term 1 LEADER]: Becoming Leader. State: Replica: 53930e27086b4fc09342b4bddbd14a28, State: Running, Role: LEADER
I20260806 18:39:22.635946 17727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } }
I20260806 18:39:22.636498 17716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:22.637928 17730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53930e27086b4fc09342b4bddbd14a28. Latest consensus state: current_term: 1 leader_uuid: "53930e27086b4fc09342b4bddbd14a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } } }
I20260806 18:39:22.637912 17729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53930e27086b4fc09342b4bddbd14a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53930e27086b4fc09342b4bddbd14a28" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46819 } } }
I20260806 18:39:22.638088 17730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:22.638088 17729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:22.638669 17741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:22.642793 17741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:22.649189 17741 catalog_manager.cc:1347] Generated new cluster ID: 03750664d91c4b12a9eef296b3b23f3c
I20260806 18:39:22.649302 17741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:22.664637 17741 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:22.665851 17741 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:22.673791 17741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53930e27086b4fc09342b4bddbd14a28: Generated new TSK 0
I20260806 18:39:22.674636 17741 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:22.716966 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:22.845649 17761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:22.845948 17761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:22.845996 17761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:22.850069 17761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:22.850135 17761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:22.850195 17761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:22.855768 17761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:22.856913 17761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:22.858016 17761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:22.868460 17769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:22.868460 17768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:22.868573 17772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:22.868744 17761 server_base.cc:1034] running on GCE node
I20260806 18:39:22.869371 17761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:22.870133 17761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:22.871361 17761 hybrid_clock.cc:648] HybridClock initialized: now 1786041562871341 us; error 31 us; skew 500 ppm
Aug 06 18:39:22 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041562, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:22.874599 17761 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:22.875679 17761 webserver.cc:460] Webserver started at http://127.12.177.129:44243/ using document root <none> and password file <none>
I20260806 18:39:22.876325 17761 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:22.876430 17761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:22.876691 17761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:22.878974 17761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "6925194abda84e20b5fdfea2e7c93eea"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "039a0f9b63a484d11c30cda17d150ad9"
server_key_iv: "29f0611b00b9052753782ff1dcabd7cc"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.879607 17761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "6925194abda84e20b5fdfea2e7c93eea"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "039a0f9b63a484d11c30cda17d150ad9"
server_key_iv: "29f0611b00b9052753782ff1dcabd7cc"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.883714 17761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:22.886778 17782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:22.888204 17761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:22.888379 17761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "6925194abda84e20b5fdfea2e7c93eea"
format_stamp: "Formatted at 2026-08-06 18:39:22 on dist-test-slave-j2vl"
server_key: "039a0f9b63a484d11c30cda17d150ad9"
server_key_iv: "29f0611b00b9052753782ff1dcabd7cc"
server_key_version: "encryptionkey@0"
I20260806 18:39:22.888514 17761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:22.903651 17761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:22.908099 17761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:22.908362 17761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:22.909076 17761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:22.910141 17761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:22.910220 17761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:22.910298 17761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:22.910516 17761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:22.923316 17761 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:38361
I20260806 18:39:22.923341 17947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:38361 every 8 connection(s)
I20260806 18:39:22.924448 17761 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:22.926031 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17761
I20260806 18:39:22.926191 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:22.926515 12998 external_mini_cluster.cc:1428] Setting key 29b025b1498eaefb361ae78b573f20f3
Aug 06 18:39:22 dist-test-slave-j2vl krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041562, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:22.944531 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:22.926820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:58647 (local address 127.12.177.190:46819)
0806 18:39:22.927001 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:22.927006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:22.928308 (+ 1302us) server_negotiation.cc:407] Connection header received
0806 18:39:22.929892 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:22.929898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:22.930392 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:22.930653 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:22.932654 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.933600 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.934923 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.935356 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.935491 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:22.939261 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:22.939278 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:22.939287 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:22.939335 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:22.941522 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:22.942338 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:22.942345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:22.942350 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:22.942497 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:22.943030 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:22.943034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:22.943035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:22.943394 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:22.943542 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:22.944172 (+ 630us) server_negotiation.cc:299] Negotiation successful
0806 18:39:22.944334 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 18:39:22.945587 17951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:22.927388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46819 (local address 127.12.177.129:58647)
0806 18:39:22.928129 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:22.928193 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:22.929634 (+ 1441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:22.930924 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:22.930961 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:22.931584 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:22.932411 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:22.932438 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.933762 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.933766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:22.934779 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:22.934791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:22.935557 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:22.935561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:22.935743 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:22.936507 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:22.936526 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:22.938722 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:22.941717 (+ 2995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:22.941725 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:22.941744 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:22.942132 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:22.942650 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:22.942653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:22.942654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:22.942859 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:22.943554 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:22.943565 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:22.943894 (+ 329us) client_negotiation.cc:769] Sending connection context
0806 18:39:22.944123 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 18:39:22.944523 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":156,"threads_started":1}
I20260806 18:39:22.947362 17948 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46819
I20260806 18:39:22.947654 17948 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:22.948243 17948 heartbeater.cc:511] Master 127.12.177.190:46819 requested a full tablet report, sending...
I20260806 18:39:22.950119 17662 ts_manager.cc:194] Registered new tserver with Master: 6925194abda84e20b5fdfea2e7c93eea (127.12.177.129:38361)
I20260806 18:39:22.951335 17662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:58647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:22.965147 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:23.087572 17955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:23.087878 17955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:23.087952 17955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:23.092555 17955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:23.092643 17955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:23.092742 17955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:23.098578 17955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:23.099884 17955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:23.101011 17955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:23.111919 17955 server_base.cc:1034] running on GCE node
W20260806 18:39:23.111838 17966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:23.111857 17964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:23.111955 17962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:23.112671 17955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:23.113427 17955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:23.114637 17955 hybrid_clock.cc:648] HybridClock initialized: now 1786041563114597 us; error 50 us; skew 500 ppm
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:23.117949 17955 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:23.118970 17955 webserver.cc:460] Webserver started at http://127.12.177.130:37031/ using document root <none> and password file <none>
I20260806 18:39:23.119583 17955 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:23.119683 17955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:23.119961 17955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:23.122223 17955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "96c3070cd89e47afbc020f908eb99a9c"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "da3770911347d9c19f42357fb5021360"
server_key_iv: "84db2aabb82b2eb7811100db8b3c1a17"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.122828 17955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "96c3070cd89e47afbc020f908eb99a9c"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "da3770911347d9c19f42357fb5021360"
server_key_iv: "84db2aabb82b2eb7811100db8b3c1a17"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.126916 17955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:23.129572 17976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.131328 17955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:23.131498 17955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "96c3070cd89e47afbc020f908eb99a9c"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "da3770911347d9c19f42357fb5021360"
server_key_iv: "84db2aabb82b2eb7811100db8b3c1a17"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.131629 17955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:23.160877 17955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:23.164440 17955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:23.164680 17955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:23.165439 17955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:23.166388 17955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:23.166463 17955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.166539 17955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:23.166585 17955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.176357 17955 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:45137
I20260806 18:39:23.176391 18134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:45137 every 8 connection(s)
I20260806 18:39:23.177392 17955 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:23.184363 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 17955
I20260806 18:39:23.184521 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:23.184866 12998 external_mini_cluster.cc:1428] Setting key f01d5abb396df3ebb5681f559f28394a
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:23.195400 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:23.179928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45557 (local address 127.12.177.190:46819)
0806 18:39:23.180115 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:23.180120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:23.181301 (+ 1181us) server_negotiation.cc:407] Connection header received
0806 18:39:23.182803 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:23.182806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:23.182868 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:23.183068 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:23.184978 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.185698 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.187363 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.187598 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.187711 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:23.190817 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:23.190825 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:23.190831 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:23.190867 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:23.192733 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.193435 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.193442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.193447 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.193548 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.193977 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.193983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.193988 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.194287 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:23.194408 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:23.195027 (+ 619us) server_negotiation.cc:299] Negotiation successful
0806 18:39:23.195194 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 18:39:23.196260 18137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:23.180471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46819 (local address 127.12.177.130:45557)
0806 18:39:23.181119 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:23.181169 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:23.182567 (+ 1398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:23.183227 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:23.183234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:23.183688 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:23.184720 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:23.184746 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.185876 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.185879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:23.187224 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:23.187236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.187777 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.187781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:23.187991 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:23.188687 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:23.188705 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:23.190600 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:23.192875 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:23.192881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:23.192896 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:23.193199 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:23.193680 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:23.193683 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:23.193685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:23.193848 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:23.194426 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:23.194432 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:23.194713 (+ 281us) client_negotiation.cc:769] Sending connection context
0806 18:39:23.194931 (+ 218us) client_negotiation.cc:240] Negotiation successful
0806 18:39:23.195259 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":180,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:23.197877 18135 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46819
I20260806 18:39:23.198275 18135 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:23.198974 18135 heartbeater.cc:511] Master 127.12.177.190:46819 requested a full tablet report, sending...
I20260806 18:39:23.200289 17662 ts_manager.cc:194] Registered new tserver with Master: 96c3070cd89e47afbc020f908eb99a9c (127.12.177.130:45137)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:23.201049 17662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:45557
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:23.221515 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:23.346751 18140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:23.347067 18140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:23.347116 18140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:23.351475 18140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:23.351550 18140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:23.351613 18140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:23.357323 18140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:23.358528 18140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:23.359620 18140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:23.370425 18148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:23.370455 18150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:23.370461 18147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:23.370837 18140 server_base.cc:1034] running on GCE node
I20260806 18:39:23.371320 18140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:23.372027 18140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:23.373235 18140 hybrid_clock.cc:648] HybridClock initialized: now 1786041563373197 us; error 52 us; skew 500 ppm
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:23.376564 18140 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:23.377696 18140 webserver.cc:460] Webserver started at http://127.12.177.131:36653/ using document root <none> and password file <none>
I20260806 18:39:23.378468 18140 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:23.378545 18140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:23.378804 18140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:23.381089 18140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "f5354938e6134939a567bfe3eb01d2ba"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "a8962f42e1c7b5ae27fdbd1db41ee532"
server_key_iv: "090ab77dd4c1cc20160a1844ab85ec52"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.381778 18140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "f5354938e6134939a567bfe3eb01d2ba"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "a8962f42e1c7b5ae27fdbd1db41ee532"
server_key_iv: "090ab77dd4c1cc20160a1844ab85ec52"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.386816 18140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:39:23.389885 18159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.391332 18140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:23.391449 18140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "f5354938e6134939a567bfe3eb01d2ba"
format_stamp: "Formatted at 2026-08-06 18:39:23 on dist-test-slave-j2vl"
server_key: "a8962f42e1c7b5ae27fdbd1db41ee532"
server_key_iv: "090ab77dd4c1cc20160a1844ab85ec52"
server_key_version: "encryptionkey@0"
I20260806 18:39:23.391608 18140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:23.408143 18140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:23.411821 18140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:23.412159 18140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:23.412878 18140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:23.413873 18140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:23.413925 18140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.413968 18140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:23.414024 18140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:23.424456 18140 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:40747
I20260806 18:39:23.424486 18321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:40747 every 8 connection(s)
I20260806 18:39:23.425498 18140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:23.430590 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 18140
I20260806 18:39:23.430763 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:23.431105 12998 external_mini_cluster.cc:1428] Setting key 82bc0568cbed9f840dd797379e34cf18
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:23.442157 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:23.427865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:48031 (local address 127.12.177.190:46819)
0806 18:39:23.428057 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:23.428061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:23.429164 (+ 1103us) server_negotiation.cc:407] Connection header received
0806 18:39:23.430910 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:23.430914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:23.430985 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:23.431098 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:23.432795 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.433393 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.434708 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.434958 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.435076 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:23.438079 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:23.438082 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:23.438084 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:23.438118 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:23.439762 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.440385 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.440394 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.440396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.440480 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.440854 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.440857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.440859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.441080 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:23.441196 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:23.441830 (+ 634us) server_negotiation.cc:299] Negotiation successful
0806 18:39:23.441976 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 18:39:23.443192 18329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:23.428356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46819 (local address 127.12.177.131:48031)
0806 18:39:23.428907 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:23.428957 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:23.430580 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:23.431318 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:23.431327 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:23.431855 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:23.432621 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:23.432646 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.433530 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.433533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:23.434568 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:23.434579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.435128 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.435132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:23.435373 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:23.436047 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:23.436073 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:23.437842 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:23.439921 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:23.439928 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:23.439954 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:23.440262 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:23.440582 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:23.440585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:23.440587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:23.440750 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:23.441205 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:23.441215 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:23.441573 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 18:39:23.441789 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 18:39:23.442190 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":144,"threads_started":1}
I20260806 18:39:23.444869 18323 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46819
I20260806 18:39:23.445170 18323 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:23.445916 18323 heartbeater.cc:511] Master 127.12.177.190:46819 requested a full tablet report, sending...
I20260806 18:39:23.447124 17662 ts_manager.cc:194] Registered new tserver with Master: f5354938e6134939a567bfe3eb01d2ba (127.12.177.131:40747)
I20260806 18:39:23.447749 17662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:48031
I20260806 18:39:23.458771 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041563, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:23.490003 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:23.479919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35442 (local address 127.12.177.190:46819)
0806 18:39:23.480109 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:23.480114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:23.480262 (+ 148us) server_negotiation.cc:407] Connection header received
0806 18:39:23.480470 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:23.480473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:23.480532 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:23.480626 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:23.481454 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.482011 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.482885 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:23.483136 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:23.483253 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:23.486332 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:23.486335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:23.486337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:23.486376 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:23.487852 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.488450 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.488453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.488455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.488545 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:23.488926 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:23.488929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:23.488931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:23.489196 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:23.489324 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:23.489709 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 18:39:23.489856 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 18:39:23.490577 17662 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35442
I20260806 18:39:23.491650 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17761
I20260806 18:39:23.502974 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17955
I20260806 18:39:23.517616 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 18140
I20260806 18:39:23.541054 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 17625
2026-08-06T18:39:23Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2556 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[18341](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[18341](info): set up 2 sockets
Aug 06 18:39:23 dist-test-slave-j2vl krb5kdc[18341](info): commencing operation
krb5kdc: starting...
W20260806 18:39:24.844691 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:24 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:24.990149 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:32789
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:32789
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:25.114686 18357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:25.115173 18357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:25.115340 18357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:25.119891 18357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:25.119973 18357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:25.119994 18357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:25.120014 18357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:25.120030 18357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:25.126164 18357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:32789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:32789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:25.127425 18357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:25.128539 18357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:25.137630 18366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:25.137678 18364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:25.137735 18357 server_base.cc:1034] running on GCE node
W20260806 18:39:25.137678 18368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:25.138445 18357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:25.139680 18357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:25.140875 18357 hybrid_clock.cc:648] HybridClock initialized: now 1786041565140857 us; error 28 us; skew 500 ppm
Aug 06 18:39:25 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041565, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:25.144248 18357 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:25.145233 18357 webserver.cc:460] Webserver started at http://127.12.177.190:39853/ using document root <none> and password file <none>
I20260806 18:39:25.145912 18357 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:25.145988 18357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:25.146183 18357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:25.148569 18357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "2a367bccfe6d454ea1aa47e77e6e35f0"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "3ae2de6ceadf7a97b4fb7978d0d75b94"
server_key_iv: "a8f68722d5d73f04c5c398a78f53e168"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.149164 18357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "2a367bccfe6d454ea1aa47e77e6e35f0"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "3ae2de6ceadf7a97b4fb7978d0d75b94"
server_key_iv: "a8f68722d5d73f04c5c398a78f53e168"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.153563 18357 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:25.156582 18379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:25.158450 18357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:25.158633 18357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "2a367bccfe6d454ea1aa47e77e6e35f0"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "3ae2de6ceadf7a97b4fb7978d0d75b94"
server_key_iv: "a8f68722d5d73f04c5c398a78f53e168"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.158782 18357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:25.177203 18357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:25.181393 18357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:25.181663 18357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:25.190623 18357 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:32789
I20260806 18:39:25.190636 18460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:32789 every 8 connection(s)
I20260806 18:39:25.191708 18357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:25.194664 18462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:25.198714 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 18357
I20260806 18:39:25.198832 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:25.199141 12998 external_mini_cluster.cc:1428] Setting key 10c8f446c0f550bd9ed15352fafd71be
I20260806 18:39:25.201243 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0: Bootstrap starting.
I20260806 18:39:25.203661 18462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:25.204511 18462 log.cc:824] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:25.206647 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0: No bootstrap required, opened a new log
Aug 06 18:39:25 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:25.211061 18462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } }
I20260806 18:39:25.211616 18462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:25.211714 18462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a367bccfe6d454ea1aa47e77e6e35f0, State: Initialized, Role: FOLLOWER
I20260806 18:39:25.212379 18462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } }
I20260806 18:39:25.212565 18462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:25.212656 18462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:25.212785 18462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:25.214020 18462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } }
I20260806 18:39:25.214409 18462 leader_election.cc:302] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a367bccfe6d454ea1aa47e77e6e35f0; no voters:
I20260806 18:39:25.214668 18465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:25.200713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.12.177.190:32789)
0806 18:39:25.201216 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:25.201233 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:25.201279 (+ 46us) server_negotiation.cc:407] Connection header received
0806 18:39:25.202046 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:25.202073 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:25.202429 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:25.202835 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:25.203753 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.204911 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.205867 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.206355 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.206530 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:25.209266 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:25.209271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:25.209290 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:25.209321 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:25.211305 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:25.211870 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:25.211876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:25.211881 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:25.212005 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:25.212314 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:25.212318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:25.212320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:25.212857 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:25.213084 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:25.213433 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 18:39:25.213747 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":155,"threads_started":1}
I20260806 18:39:25.214794 18462 leader_election.cc:288] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:25.214917 18468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:25.215173 18468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [term 1 LEADER]: Becoming Leader. State: Replica: 2a367bccfe6d454ea1aa47e77e6e35f0, State: Running, Role: LEADER
I20260806 18:39:25.215530 18468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } }
I20260806 18:39:25.216215 18462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:25.217759 18469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } } }
I20260806 18:39:25.217904 18469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:25.218343 18479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:25.218343 18471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a367bccfe6d454ea1aa47e77e6e35f0. Latest consensus state: current_term: 1 leader_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a367bccfe6d454ea1aa47e77e6e35f0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 32789 } } }
I20260806 18:39:25.218575 18471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:25.221436 18479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:25.227888 18479 catalog_manager.cc:1347] Generated new cluster ID: 474c712df8c644cead6e30375f7d4b71
I20260806 18:39:25.228005 18479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:25.244903 18479 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:25.246140 18479 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:25.250859 18479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a367bccfe6d454ea1aa47e77e6e35f0: Generated new TSK 0
I20260806 18:39:25.251688 18479 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:25.288820 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:25.422799 18494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:25.423131 18494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:25.423180 18494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:25.427716 18494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:25.427798 18494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:25.427865 18494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:25.433950 18494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:25.435276 18494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:25.436494 18494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:25.447610 18505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:25.447623 18500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:25.447582 18502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:25.448083 18494 server_base.cc:1034] running on GCE node
I20260806 18:39:25.448573 18494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:25.449312 18494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:25.450578 18494 hybrid_clock.cc:648] HybridClock initialized: now 1786041565450553 us; error 46 us; skew 500 ppm
Aug 06 18:39:25 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041565, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:25.453949 18494 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:25.455019 18494 webserver.cc:460] Webserver started at http://127.12.177.129:33695/ using document root <none> and password file <none>
I20260806 18:39:25.455646 18494 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:25.455746 18494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:25.455999 18494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:25.458343 18494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "9f3424895c4247909c7285847a3737c4"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "5ebf4b140a3df6f7473fd09f635723ba"
server_key_iv: "d1ee8e490ae1491b8e8cd9e1c102f14a"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.458968 18494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "9f3424895c4247909c7285847a3737c4"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "5ebf4b140a3df6f7473fd09f635723ba"
server_key_iv: "d1ee8e490ae1491b8e8cd9e1c102f14a"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.463284 18494 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 18:39:25.466357 18519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:25.468212 18494 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:39:25.468379 18494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "9f3424895c4247909c7285847a3737c4"
format_stamp: "Formatted at 2026-08-06 18:39:25 on dist-test-slave-j2vl"
server_key: "5ebf4b140a3df6f7473fd09f635723ba"
server_key_iv: "d1ee8e490ae1491b8e8cd9e1c102f14a"
server_key_version: "encryptionkey@0"
I20260806 18:39:25.468536 18494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:25.489749 18494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:25.493234 18494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:25.493527 18494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:25.494230 18494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:25.495209 18494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:25.495293 18494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:25.495366 18494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:25.495429 18494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:25.505638 18494 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:39395
I20260806 18:39:25.505703 18696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:39395 every 8 connection(s)
I20260806 18:39:25.506729 18494 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:25.507886 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 18494
I20260806 18:39:25.508018 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:25.508374 12998 external_mini_cluster.cc:1428] Setting key 7495613e2017dcdd6d15fab5497d0990
Aug 06 18:39:25 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041565, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:25.525061 18465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:25.509002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:39363 (local address 127.12.177.190:32789)
0806 18:39:25.509140 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:25.509143 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:25.510370 (+ 1227us) server_negotiation.cc:407] Connection header received
0806 18:39:25.512614 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:25.512620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:25.512692 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:25.512812 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:25.514237 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.515164 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.517088 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.517585 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.517746 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:25.520679 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:25.520684 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:25.520691 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:25.520739 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:25.522572 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:25.523284 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:25.523288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:25.523290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:25.523392 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:25.523774 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:25.523777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:25.523779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:25.524002 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:25.524120 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:25.524708 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 18:39:25.524874 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 18:39:25.526046 18699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:25.509546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:32789 (local address 127.12.177.129:39363)
0806 18:39:25.510167 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:25.510232 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:25.512256 (+ 2024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:25.512977 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:25.512985 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:25.513488 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:25.514062 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:25.514078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.515313 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.515315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:25.516552 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:25.516571 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:25.517819 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:25.517822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:25.518001 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:25.518810 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:25.518829 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:25.520406 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:25.522752 (+ 2346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:25.522763 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:25.522786 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:25.523160 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:25.523495 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:25.523499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:25.523501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:25.523663 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:25.524120 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:25.524129 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:25.524433 (+ 304us) client_negotiation.cc:769] Sending connection context
0806 18:39:25.524646 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 18:39:25.525039 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":176,"threads_started":1}
I20260806 18:39:25.527375 18697 heartbeater.cc:347] Connected to a master server at 127.12.177.190:32789
I20260806 18:39:25.527667 18697 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:25.528280 18697 heartbeater.cc:511] Master 127.12.177.190:32789 requested a full tablet report, sending...
I20260806 18:39:25.530006 18407 ts_manager.cc:194] Registered new tserver with Master: 9f3424895c4247909c7285847a3737c4 (127.12.177.129:39395)
I20260806 18:39:25.531211 18407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:39363
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
W20260806 18:39:26.246800 12998 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.12.177.130: real 0.736s user 0.003s sys 0.002s
I20260806 18:39:26.247344 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:26.386731 18702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:26.387100 18702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:26.387176 18702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:26.391990 18702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:26.392130 18702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:26.392237 18702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:26.398267 18702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:26.399621 18702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:26.400837 18702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:26.413983 18708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:26.414218 18702 server_base.cc:1034] running on GCE node
W20260806 18:39:26.414007 18707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:26.414009 18711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:26.414942 18702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:26.415699 18702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:26.417243 18702 hybrid_clock.cc:648] HybridClock initialized: now 1786041566417213 us; error 57 us; skew 500 ppm
Aug 06 18:39:26 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041566, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:26.422278 18702 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:26.423604 18702 webserver.cc:460] Webserver started at http://127.12.177.130:35989/ using document root <none> and password file <none>
I20260806 18:39:26.424306 18702 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:26.424383 18702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:26.424644 18702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:26.427556 18702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "c9037c724e3a4af4b86a3680d784acc4"
format_stamp: "Formatted at 2026-08-06 18:39:26 on dist-test-slave-j2vl"
server_key: "8b1fb1443f806a6c963798c00efa5e70"
server_key_iv: "98122e4711dad6424999cfd63158b6f0"
server_key_version: "encryptionkey@0"
I20260806 18:39:26.428386 18702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "c9037c724e3a4af4b86a3680d784acc4"
format_stamp: "Formatted at 2026-08-06 18:39:26 on dist-test-slave-j2vl"
server_key: "8b1fb1443f806a6c963798c00efa5e70"
server_key_iv: "98122e4711dad6424999cfd63158b6f0"
server_key_version: "encryptionkey@0"
I20260806 18:39:26.432976 18702 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:26.436534 18722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:26.438390 18702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 18:39:26.438565 18702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "c9037c724e3a4af4b86a3680d784acc4"
format_stamp: "Formatted at 2026-08-06 18:39:26 on dist-test-slave-j2vl"
server_key: "8b1fb1443f806a6c963798c00efa5e70"
server_key_iv: "98122e4711dad6424999cfd63158b6f0"
server_key_version: "encryptionkey@0"
I20260806 18:39:26.438714 18702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:26.453617 18702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:26.457903 18702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:26.458169 18702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:26.458878 18702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:26.459856 18702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:26.459932 18702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:26.460028 18702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:26.460079 18702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:26.473543 18702 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:34709
I20260806 18:39:26.473588 18888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:34709 every 8 connection(s)
I20260806 18:39:26.474575 18702 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:26.477049 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 18702
I20260806 18:39:26.477185 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:26.477555 12998 external_mini_cluster.cc:1428] Setting key a1359b6e15aa4046bc1db2ea24d0745a
Aug 06 18:39:26 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041566, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:26.491012 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:26.476725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:59489 (local address 127.12.177.190:32789)
0806 18:39:26.477093 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:26.477099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:26.477859 (+ 760us) server_negotiation.cc:407] Connection header received
0806 18:39:26.479381 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:26.479385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:26.479462 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:26.479582 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:26.480918 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:26.481576 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:26.483046 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:26.483284 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:26.483405 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:26.486333 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:26.486336 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:26.486339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:26.486366 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:26.488194 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:26.488815 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:26.488822 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:26.488826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:26.488960 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:26.489484 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:26.489491 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:26.489493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:26.489783 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:26.489903 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:26.490563 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 18:39:26.490738 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":109,"threads_started":1}
I20260806 18:39:26.491788 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:26.477040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:32789 (local address 127.12.177.130:59489)
0806 18:39:26.477669 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:26.477725 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:26.479136 (+ 1411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:26.479772 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:26.479779 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:26.480180 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:26.480735 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:26.480750 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:26.481722 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:26.481726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:26.482908 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:26.482918 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:26.483457 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:26.483461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:26.483652 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:26.484325 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:26.484342 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:26.486131 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:26.488339 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:26.488345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:26.488360 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:26.488691 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:26.489082 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:26.489085 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:26.489086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:26.489329 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:26.489951 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:26.489958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:26.490251 (+ 293us) client_negotiation.cc:769] Sending connection context
0806 18:39:26.490443 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 18:39:26.490764 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":224,"threads_started":1}
I20260806 18:39:26.493052 18889 heartbeater.cc:347] Connected to a master server at 127.12.177.190:32789
I20260806 18:39:26.493325 18889 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:26.493959 18889 heartbeater.cc:511] Master 127.12.177.190:32789 requested a full tablet report, sending...
I20260806 18:39:26.495177 18407 ts_manager.cc:194] Registered new tserver with Master: c9037c724e3a4af4b86a3680d784acc4 (127.12.177.130:34709)
I20260806 18:39:26.495841 18407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:59489
I20260806 18:39:26.533905 18697 heartbeater.cc:503] Master 127.12.177.190:32789 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
W20260806 18:39:27.121609 12998 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.12.177.131: real 0.638s user 0.002s sys 0.003s
I20260806 18:39:27.122270 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:27.244979 18897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:27.245510 18897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:27.245605 18897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:27.249998 18897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:27.250080 18897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:27.250146 18897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:27.256537 18897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:27.257874 18897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:27.259213 18897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:27.270852 18904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:27.270852 18907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:27.270836 18909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:27.271338 18897 server_base.cc:1034] running on GCE node
I20260806 18:39:27.271814 18897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:27.272607 18897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:27.273850 18897 hybrid_clock.cc:648] HybridClock initialized: now 1786041567273827 us; error 40 us; skew 500 ppm
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041567, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:27.276993 18897 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:27.278208 18897 webserver.cc:460] Webserver started at http://127.12.177.131:34203/ using document root <none> and password file <none>
I20260806 18:39:27.278847 18897 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:27.278961 18897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:27.279224 18897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:27.281736 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "f90dd95f3cd64835af20de593dec8996"
format_stamp: "Formatted at 2026-08-06 18:39:27 on dist-test-slave-j2vl"
server_key: "daa257d3c8d424dd44cb23bdaa63e7f6"
server_key_iv: "a33e9596db353f405734a12a42cec81b"
server_key_version: "encryptionkey@0"
I20260806 18:39:27.282415 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "f90dd95f3cd64835af20de593dec8996"
format_stamp: "Formatted at 2026-08-06 18:39:27 on dist-test-slave-j2vl"
server_key: "daa257d3c8d424dd44cb23bdaa63e7f6"
server_key_iv: "a33e9596db353f405734a12a42cec81b"
server_key_version: "encryptionkey@0"
I20260806 18:39:27.287204 18897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:27.290745 18920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:27.292503 18897 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:27.292713 18897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "f90dd95f3cd64835af20de593dec8996"
format_stamp: "Formatted at 2026-08-06 18:39:27 on dist-test-slave-j2vl"
server_key: "daa257d3c8d424dd44cb23bdaa63e7f6"
server_key_iv: "a33e9596db353f405734a12a42cec81b"
server_key_version: "encryptionkey@0"
I20260806 18:39:27.292891 18897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:27.312686 18897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:27.316848 18897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:27.317104 18897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:27.317946 18897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:27.319031 18897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:27.319087 18897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:27.319132 18897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:27.319149 18897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:27.329128 18897 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:40213
I20260806 18:39:27.329165 19086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:40213 every 8 connection(s)
I20260806 18:39:27.330147 18897 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:27.331121 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 18897
I20260806 18:39:27.331275 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:27.331586 12998 external_mini_cluster.cc:1428] Setting key f0887df9e2fe0ef76ee109978049cddc
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041567, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:27.346536 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:27.332365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:47039 (local address 127.12.177.190:32789)
0806 18:39:27.332680 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:27.332684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:27.333942 (+ 1258us) server_negotiation.cc:407] Connection header received
0806 18:39:27.335439 (+ 1497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:27.335443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:27.335502 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:27.335593 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:27.336873 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.337859 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.339166 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.339415 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.339541 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:27.342269 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:27.342272 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:27.342275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:27.342303 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:27.343867 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.344553 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.344557 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.344559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.344684 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.345212 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.345214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.345216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.345520 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:27.345658 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:27.346206 (+ 548us) server_negotiation.cc:299] Negotiation successful
0806 18:39:27.346346 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":111,"threads_started":1}
I20260806 18:39:27.347420 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:27.332924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:32789 (local address 127.12.177.131:47039)
0806 18:39:27.333675 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:27.333721 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:27.335174 (+ 1453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:27.335784 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:27.335791 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:27.336190 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:27.336715 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:27.336730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.338038 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.338044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:27.339020 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:27.339031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.339595 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.339600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:27.339790 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:27.340404 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:27.340423 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:27.342069 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:27.343997 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:27.344004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:27.344024 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:27.344390 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:27.344791 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:27.344794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:27.344796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:27.345003 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:27.345655 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:27.345661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:27.345951 (+ 290us) client_negotiation.cc:769] Sending connection context
0806 18:39:27.346164 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 18:39:27.346543 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":165,"threads_started":1}
I20260806 18:39:27.348714 19087 heartbeater.cc:347] Connected to a master server at 127.12.177.190:32789
I20260806 18:39:27.348948 19087 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:27.349570 19087 heartbeater.cc:511] Master 127.12.177.190:32789 requested a full tablet report, sending...
I20260806 18:39:27.350662 18407 ts_manager.cc:194] Registered new tserver with Master: f90dd95f3cd64835af20de593dec8996 (127.12.177.131:40213)
I20260806 18:39:27.351274 18407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:47039
I20260806 18:39:27.358369 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[18341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:27.387312 19095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:27.377196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56334 (local address 127.12.177.129:39395)
0806 18:39:27.377539 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:27.377548 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:27.377576 (+ 28us) server_negotiation.cc:407] Connection header received
0806 18:39:27.377690 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:27.377700 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:27.377936 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:27.378112 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:27.378856 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.379646 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.380506 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.380908 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.381033 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:27.383788 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:27.383800 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:27.383816 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:27.383845 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:27.385547 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.386019 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.386024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.386026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.386112 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.386356 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.386358 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.386359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.386622 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:27.386799 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:27.387011 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 18:39:27.387151 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":78,"threads_started":1}
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[18341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:27.399577 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:27.390620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48942 (local address 127.12.177.190:32789)
0806 18:39:27.390757 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:27.390761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:27.390774 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:39:27.390894 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:27.390896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:27.390938 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:27.391002 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:27.391594 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.392119 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.392853 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:27.393070 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:27.393143 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:27.395702 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:27.395706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:27.395708 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:27.395735 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:27.397163 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.398164 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.398173 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.398174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.398276 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:27.398576 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:27.398580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:27.398581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:27.398856 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:27.399013 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:27.399257 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 18:39:27.399404 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 18:39:27.400003 18407 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48942
I20260806 18:39:27.400684 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 18494
I20260806 18:39:27.417795 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 18702
I20260806 18:39:27.430354 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 18897
I20260806 18:39:27.446861 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 18357
2026-08-06T18:39:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3906 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[19101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[19101](info): set up 2 sockets
Aug 06 18:39:27 dist-test-slave-j2vl krb5kdc[19101](info): commencing operation
krb5kdc: starting...
W20260806 18:39:28.741678 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:28 dist-test-slave-j2vl krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:28.885604 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36709
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:36709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:29.010255 19123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:29.010623 19123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:29.010708 19123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:29.014940 19123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:29.015054 19123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:29.015095 19123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:29.015136 19123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:29.015170 19123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:29.020774 19123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:36709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:29.022100 19123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:29.023455 19123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:29.033311 19129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:29.033313 19128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.033444 19123 server_base.cc:1034] running on GCE node
W20260806 18:39:29.033468 19131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.034435 19123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:29.035910 19123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:29.037143 19123 hybrid_clock.cc:648] HybridClock initialized: now 1786041569037115 us; error 50 us; skew 500 ppm
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:29.050932 19123 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:29.051919 19123 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:29.052007 19123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:29.052263 19123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:29.054798 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "d242b7b104b54d96bf4189e00d48051c"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "281607e58cd32d2e2632fc83a62d012c"
server_key_iv: "847496037eaf60d75310a4020cf020a3"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.055485 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "d242b7b104b54d96bf4189e00d48051c"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "281607e58cd32d2e2632fc83a62d012c"
server_key_iv: "847496037eaf60d75310a4020cf020a3"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.059767 19123 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:29.062605 19142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.064072 19123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:29.064245 19123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d242b7b104b54d96bf4189e00d48051c"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "281607e58cd32d2e2632fc83a62d012c"
server_key_iv: "847496037eaf60d75310a4020cf020a3"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.064386 19123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:29.086282 19123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:29.090694 19123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:29.090972 19123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:29.099133 19123 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:36709
I20260806 18:39:29.099428 19230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:36709 every 8 connection(s)
I20260806 18:39:29.099979 19123 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:29.103389 19232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:29.105036 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 19123
I20260806 18:39:29.105188 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:29.105533 12998 external_mini_cluster.cc:1428] Setting key 023c2dcfa6f907040c18d6a98c072b06
I20260806 18:39:29.110786 19232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: Bootstrap starting.
I20260806 18:39:29.113544 19232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:29.114540 19232 log.cc:824] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:29.117213 19232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: No bootstrap required, opened a new log
I20260806 18:39:29.121901 19232 raft_consensus.cc:348] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } }
I20260806 18:39:29.122190 19232 raft_consensus.cc:374] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:29.122228 19232 raft_consensus.cc:729] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d242b7b104b54d96bf4189e00d48051c, State: Initialized, Role: FOLLOWER
I20260806 18:39:29.122808 19232 consensus_queue.cc:260] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } }
I20260806 18:39:29.122951 19232 raft_consensus.cc:388] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:29.123046 19232 raft_consensus.cc:482] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:29.123134 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.107220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48384 (local address 127.12.177.190:36709)
0806 18:39:29.107843 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.107861 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.107944 (+ 83us) server_negotiation.cc:407] Connection header received
0806 18:39:29.108649 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.108669 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.109066 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.109530 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:29.110607 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.111703 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.112652 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.113174 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.113402 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.116767 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:29.116774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:29.116791 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:29.116823 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:29.118869 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.119547 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.119553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.119559 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.119815 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.120200 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.120204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.120205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.120702 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:29.121015 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.121543 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.121930 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":192,"threads_started":1}
I20260806 18:39:29.123157 19232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:29.124305 19232 raft_consensus.cc:504] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } }
I20260806 18:39:29.124689 19232 leader_election.cc:302] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d242b7b104b54d96bf4189e00d48051c; no voters:
I20260806 18:39:29.124993 19232 leader_election.cc:288] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:29.125231 19240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:29.125494 19240 raft_consensus.cc:686] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [term 1 LEADER]: Becoming Leader. State: Replica: d242b7b104b54d96bf4189e00d48051c, State: Running, Role: LEADER
I20260806 18:39:29.125867 19240 consensus_queue.cc:237] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } }
I20260806 18:39:29.126595 19232 sys_catalog.cc:564] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:29.127868 19244 sys_catalog.cc:455] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d242b7b104b54d96bf4189e00d48051c. Latest consensus state: current_term: 1 leader_uuid: "d242b7b104b54d96bf4189e00d48051c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } } }
I20260806 18:39:29.128139 19244 sys_catalog.cc:458] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:29.128418 19243 sys_catalog.cc:455] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d242b7b104b54d96bf4189e00d48051c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242b7b104b54d96bf4189e00d48051c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36709 } } }
I20260806 18:39:29.128551 19243 sys_catalog.cc:458] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:29.128736 19254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:29.132323 19254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:29.140180 19254 catalog_manager.cc:1347] Generated new cluster ID: 816ba3c5fe1b47e4b98db5e9a395455a
I20260806 18:39:29.140338 19254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:29.156806 19254 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:29.158015 19254 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:29.166322 19254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: Generated new TSK 0
I20260806 18:39:29.167631 19254 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:29.210239 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:29.332618 19274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:29.332988 19274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:29.333042 19274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:29.337544 19274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:29.337626 19274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:29.337747 19274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:29.343326 19274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:29.344569 19274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:29.345749 19274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:29.356884 19291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:29.356850 19283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.357034 19274 server_base.cc:1034] running on GCE node
W20260806 18:39:29.357302 19289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.357903 19274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:29.358901 19274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:29.360146 19274 hybrid_clock.cc:648] HybridClock initialized: now 1786041569360125 us; error 43 us; skew 500 ppm
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:29.363770 19274 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:29.364696 19274 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:29.364804 19274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:29.365077 19274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:29.367550 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "c3ada8caf4834ee48559ed4d21db9186"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "d5abdebd51733dcab74fabdc52875292"
server_key_iv: "ff73c8b71983cc1ab119b6359ced0fa0"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.368352 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "c3ada8caf4834ee48559ed4d21db9186"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "d5abdebd51733dcab74fabdc52875292"
server_key_iv: "ff73c8b71983cc1ab119b6359ced0fa0"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.372679 19274 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:29.375545 19302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.377002 19274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:29.377172 19274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "c3ada8caf4834ee48559ed4d21db9186"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "d5abdebd51733dcab74fabdc52875292"
server_key_iv: "ff73c8b71983cc1ab119b6359ced0fa0"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.377311 19274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:29.396471 19274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:29.399991 19274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:29.400221 19274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:29.400877 19274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:29.401818 19274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:29.401898 19274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.401973 19274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:29.402021 19274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.411732 19274 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37427
I20260806 18:39:29.411752 19470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37427 every 8 connection(s)
I20260806 18:39:29.412431 19274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:29.419610 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 19274
I20260806 18:39:29.419754 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:29.420061 12998 external_mini_cluster.cc:1428] Setting key ff81f4977b5917e09d6581f678ad78b8
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:29.428893 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.414425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:49043 (local address 127.12.177.190:36709)
0806 18:39:29.414592 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.414597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.415959 (+ 1362us) server_negotiation.cc:407] Connection header received
0806 18:39:29.416820 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.416822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.416891 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.416966 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:29.418339 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.418896 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.420490 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.420812 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.420940 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.424170 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:29.424176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:29.424181 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:29.424218 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:29.426029 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.426732 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.426739 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.426744 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.426851 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.427227 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.427234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.427239 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.427612 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:29.427729 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.428551 (+ 822us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.428687 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:39:29.430387 19474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.414890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36709 (local address 127.12.177.129:49043)
0806 18:39:29.415776 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.415823 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.416631 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.417150 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.417157 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.417656 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:29.418165 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.418179 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.419029 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.419031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.420331 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.420343 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.420995 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.420999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.421150 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.421901 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:29.421923 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:29.423938 (+ 2015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:29.426215 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.426221 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.426236 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.426621 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.426953 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.426955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.426957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.427119 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.427765 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:29.427774 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:29.428118 (+ 344us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.428387 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.428978 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":128,"threads_started":1}
I20260806 18:39:29.432278 19471 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36709
I20260806 18:39:29.432619 19471 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:29.433382 19471 heartbeater.cc:511] Master 127.12.177.190:36709 requested a full tablet report, sending...
I20260806 18:39:29.435458 19168 ts_manager.cc:194] Registered new tserver with Master: c3ada8caf4834ee48559ed4d21db9186 (127.12.177.129:37427)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:29.437003 19168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:49043
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:29.457135 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:29.578634 19480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:29.579010 19480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:29.579105 19480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:29.583498 19480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:29.583606 19480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:29.583700 19480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:29.589439 19480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:29.590689 19480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:29.591818 19480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:29.602310 19488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:29.602310 19487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:29.602314 19490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.602355 19480 server_base.cc:1034] running on GCE node
I20260806 18:39:29.603073 19480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:29.603781 19480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:29.605024 19480 hybrid_clock.cc:648] HybridClock initialized: now 1786041569604994 us; error 35 us; skew 500 ppm
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:29.608213 19480 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:29.609153 19480 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:29.609261 19480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:29.609570 19480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:29.611841 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "b41302453f9a4e9c837cfb7618958cbf"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "4dd4da7bb2e87b8002039107d030ffb0"
server_key_iv: "084f9dd3de1700cb57cdcdfd665c020c"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.612496 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "b41302453f9a4e9c837cfb7618958cbf"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "4dd4da7bb2e87b8002039107d030ffb0"
server_key_iv: "084f9dd3de1700cb57cdcdfd665c020c"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.616786 19480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260806 18:39:29.619620 19503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.621006 19480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 18:39:29.621174 19480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "b41302453f9a4e9c837cfb7618958cbf"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "4dd4da7bb2e87b8002039107d030ffb0"
server_key_iv: "084f9dd3de1700cb57cdcdfd665c020c"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.621308 19480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:29.637614 19480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:29.641021 19480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:29.641259 19480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:29.641964 19480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:29.642900 19480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:29.643095 19480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.643200 19480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:29.643250 19480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.652957 19480 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44541
I20260806 18:39:29.653003 19693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44541 every 8 connection(s)
I20260806 18:39:29.653743 19480 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:29.656239 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 19480
I20260806 18:39:29.656383 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:29.656684 12998 external_mini_cluster.cc:1428] Setting key 67fef05198c251aa2829bb2dfa1ad59a
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:29.670264 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.655827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:40343 (local address 127.12.177.190:36709)
0806 18:39:29.656108 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.656115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.657681 (+ 1566us) server_negotiation.cc:407] Connection header received
0806 18:39:29.658655 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.658659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.658715 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.658822 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:29.660086 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.660760 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.662121 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.662493 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.662617 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.665573 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:29.665581 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:29.665588 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:29.665628 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:29.667502 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.668311 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.668315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.668317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.668418 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.668891 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.668900 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.668902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.669143 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:29.669268 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.669939 (+ 671us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.670087 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260806 18:39:29.671222 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.656437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36709 (local address 127.12.177.130:40343)
0806 18:39:29.657486 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.657553 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.658418 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.659018 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.659027 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.659413 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:29.659934 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.659951 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.660921 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.660924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.661991 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.662003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.662669 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.662672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.662877 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.663545 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:29.663562 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:29.665310 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:29.667667 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.667673 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.667690 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.668123 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.668527 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.668529 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.668530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.668767 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.669268 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:29.669277 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:29.669654 (+ 377us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.669873 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.670280 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":154,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:29.672888 19694 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36709
I20260806 18:39:29.673187 19694 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:29.673867 19694 heartbeater.cc:511] Master 127.12.177.190:36709 requested a full tablet report, sending...
I20260806 18:39:29.675244 19168 ts_manager.cc:194] Registered new tserver with Master: b41302453f9a4e9c837cfb7618958cbf (127.12.177.130:44541)
I20260806 18:39:29.675977 19168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:40343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:29.693217 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:29.819576 19702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:29.819888 19702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:29.819937 19702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:29.824213 19702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:29.824301 19702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:29.824366 19702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:29.830744 19702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:29.831981 19702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:29.833081 19702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:29.844132 19712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:29.844132 19707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.844380 19702 server_base.cc:1034] running on GCE node
W20260806 18:39:29.844131 19708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:29.845377 19702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:29.846261 19702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:29.847478 19702 hybrid_clock.cc:648] HybridClock initialized: now 1786041569847458 us; error 37 us; skew 500 ppm
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:29.850764 19702 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:29.851578 19702 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:29.851648 19702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:29.851828 19702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:29.854216 19702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "1fed3637d4ca415c9893168e393e322b"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "47bab471b9b4ce45a916208080455762"
server_key_iv: "fbfc17d3e71a8cfade8913901c99d451"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.854826 19702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "1fed3637d4ca415c9893168e393e322b"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "47bab471b9b4ce45a916208080455762"
server_key_iv: "fbfc17d3e71a8cfade8913901c99d451"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.859032 19702 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:29.861935 19724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.863334 19702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:29.863499 19702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "1fed3637d4ca415c9893168e393e322b"
format_stamp: "Formatted at 2026-08-06 18:39:29 on dist-test-slave-j2vl"
server_key: "47bab471b9b4ce45a916208080455762"
server_key_iv: "fbfc17d3e71a8cfade8913901c99d451"
server_key_version: "encryptionkey@0"
I20260806 18:39:29.863633 19702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:29.912618 19702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:29.916383 19702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:29.916626 19702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:29.917351 19702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:29.918656 19702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:29.918742 19702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.918823 19702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:29.918854 19702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:29.928545 19702 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:41657
I20260806 18:39:29.928563 19913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:41657 every 8 connection(s)
I20260806 18:39:29.929293 19702 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:29.932526 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 19702
I20260806 18:39:29.932674 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:29.933032 12998 external_mini_cluster.cc:1428] Setting key 6d909e5b939ee46f833c0aaaaa6f7d48
Aug 06 18:39:29 dist-test-slave-j2vl krb5kdc[19101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041569, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:29.945508 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.931246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:52199 (local address 127.12.177.190:36709)
0806 18:39:29.931397 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.931400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.932518 (+ 1118us) server_negotiation.cc:407] Connection header received
0806 18:39:29.934196 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.934200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.934262 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.934338 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:29.936047 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.936652 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.937954 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.938194 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.938314 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.941447 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:29.941451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:29.941454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:29.941485 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:29.943033 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.943709 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.943713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.943717 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.943814 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.944215 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.944219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.944221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.944442 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:29.944559 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.945147 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.945290 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:29.946429 19918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.931693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36709 (local address 127.12.177.131:52199)
0806 18:39:29.932303 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.932392 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.933949 (+ 1557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.934530 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.934538 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.935082 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:29.935889 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.935905 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.936797 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.936801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.937815 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.937827 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.938375 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.938380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.938564 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.939321 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:29.939341 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:29.941160 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:29.943204 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.943213 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.943241 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.943584 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.943922 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:29.943925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:29.943927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:29.944107 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:29.944575 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:29.944585 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:29.944876 (+ 291us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.945086 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.945509 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":130,"threads_started":1}
I20260806 18:39:29.947726 19915 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36709
I20260806 18:39:29.948040 19915 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:29.948549 19915 heartbeater.cc:511] Master 127.12.177.190:36709 requested a full tablet report, sending...
I20260806 18:39:29.949682 19168 ts_manager.cc:194] Registered new tserver with Master: 1fed3637d4ca415c9893168e393e322b (127.12.177.131:41657)
I20260806 18:39:29.950289 19168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:52199
I20260806 18:39:29.960513 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:39:29.971062 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.962925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48390 (local address 127.12.177.190:36709)
0806 18:39:29.963063 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.963067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.963259 (+ 192us) server_negotiation.cc:407] Connection header received
0806 18:39:29.963392 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.963395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.963442 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.963519 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:29.964274 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.964798 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.965820 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.966060 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.966146 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.967594 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:29.967597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:29.967599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:29.967622 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:29.969221 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.969768 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.969771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.969772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.969860 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:29.970228 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:29.970231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:29.970233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:29.970494 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:29.970602 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.970821 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.970934 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:39:29.974324 19168 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:29.977588 19168 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:29.994472 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.987945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44541 (local address 127.0.0.1:38934)
0806 18:39:29.988394 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.988462 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.988616 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.989416 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.989422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.989445 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:29.989621 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.989629 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.991030 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.991034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.992498 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.992512 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.993823 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.993827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.993957 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.994021 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.994137 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.994289 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"spinlock_wait_cycles":16256,"thread_start_us":134,"threads_started":1}
I20260806 18:39:29.994791 19933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.987971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37427 (local address 127.0.0.1:39074)
0806 18:39:29.988553 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.988565 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.988636 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.990341 (+ 1705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.990344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.990365 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:29.990469 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.990477 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.992015 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.992019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.993185 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.993194 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.994387 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.994391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.994481 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.994512 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.994570 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.994640 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":132,"threads_started":1}
I20260806 18:39:29.994798 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.988104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38934 (local address 127.12.177.130:44541)
0806 18:39:29.988843 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.988858 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.988887 (+ 29us) server_negotiation.cc:407] Connection header received
0806 18:39:29.988981 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.988986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.989229 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.989437 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:29.989763 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.990863 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.992660 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.993677 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.993818 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.993991 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.994348 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.994458 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":133,"threads_started":1}
I20260806 18:39:29.995205 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.988823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:41657 (local address 127.0.0.1:59666)
0806 18:39:29.989154 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:29.989167 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:29.989258 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:29.990618 (+ 1360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:29.990622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:29.990647 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:29.990749 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.990756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.991803 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.991810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.993085 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:29.993096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.994102 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.994106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:29.994209 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.994236 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:39:29.994329 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 18:39:29.994416 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":52,"thread_start_us":123,"threads_started":1}
I20260806 18:39:29.995548 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.989321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39074 (local address 127.12.177.129:37427)
0806 18:39:29.989696 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.989704 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.989729 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:39:29.989808 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.989813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.990117 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.990351 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:29.990586 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.991889 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.993300 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.994221 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.995033 (+ 812us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.995188 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.995253 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.995388 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":158,"threads_started":1}
I20260806 18:39:29.995609 19937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:29.989001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.12.177.131:41657)
0806 18:39:29.989851 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:29.989863 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:29.989882 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:39:29.990064 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:29.990071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:29.990269 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:29.990426 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:29.990905 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.991659 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.993244 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:29.993979 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:29.994118 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:29.994248 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:29.994559 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 18:39:29.995445 (+ 886us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":178,"threads_started":1}
I20260806 18:39:29.999015 19373 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffa75478524ce38d2571b75db22538 (DEFAULT_TABLE table=test-table [id=449574c84ffe4074ab4c452c2bb83e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:29.998983 19801 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffa75478524ce38d2571b75db22538 (DEFAULT_TABLE table=test-table [id=449574c84ffe4074ab4c452c2bb83e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:29.998853 19581 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffa75478524ce38d2571b75db22538 (DEFAULT_TABLE table=test-table [id=449574c84ffe4074ab4c452c2bb83e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:30.000146 19581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffa75478524ce38d2571b75db22538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:30.000146 19801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffa75478524ce38d2571b75db22538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:30.000401 19373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffa75478524ce38d2571b75db22538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:30.007477 19939 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Bootstrap starting.
I20260806 18:39:30.008523 19940 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Bootstrap starting.
I20260806 18:39:30.008934 19942 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Bootstrap starting.
I20260806 18:39:30.010142 19939 tablet_bootstrap.cc:654] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:30.010859 19940 tablet_bootstrap.cc:654] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:30.010923 19942 tablet_bootstrap.cc:654] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:30.010957 19939 log.cc:824] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:30.012158 19940 log.cc:824] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:30.012158 19942 log.cc:824] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:30.013497 19939 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: No bootstrap required, opened a new log
I20260806 18:39:30.013729 19939 ts_tablet_manager.cc:1397] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:39:30.014282 19942 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: No bootstrap required, opened a new log
I20260806 18:39:30.014281 19940 tablet_bootstrap.cc:492] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: No bootstrap required, opened a new log
I20260806 18:39:30.014480 19940 ts_tablet_manager.cc:1397] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260806 18:39:30.014480 19942 ts_tablet_manager.cc:1397] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:39:30.017433 19939 raft_consensus.cc:348] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.017735 19939 raft_consensus.cc:374] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:30.017791 19939 raft_consensus.cc:729] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ada8caf4834ee48559ed4d21db9186, State: Initialized, Role: FOLLOWER
I20260806 18:39:30.018265 19939 consensus_queue.cc:260] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.018661 19940 raft_consensus.cc:348] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.018661 19942 raft_consensus.cc:348] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.018944 19942 raft_consensus.cc:374] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:30.018944 19940 raft_consensus.cc:374] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:30.018998 19942 raft_consensus.cc:729] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b41302453f9a4e9c837cfb7618958cbf, State: Initialized, Role: FOLLOWER
I20260806 18:39:30.018998 19940 raft_consensus.cc:729] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fed3637d4ca415c9893168e393e322b, State: Initialized, Role: FOLLOWER
I20260806 18:39:30.019440 19939 ts_tablet_manager.cc:1428] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:39:30.019459 19940 consensus_queue.cc:260] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.019448 19942 consensus_queue.cc:260] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.019855 19471 heartbeater.cc:503] Master 127.12.177.190:36709 was elected leader, sending a full tablet report...
I20260806 18:39:30.020463 19940 ts_tablet_manager.cc:1428] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260806 18:39:30.020463 19942 ts_tablet_manager.cc:1428] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260806 18:39:30.020488 19915 heartbeater.cc:503] Master 127.12.177.190:36709 was elected leader, sending a full tablet report...
I20260806 18:39:30.021586 19694 heartbeater.cc:503] Master 127.12.177.190:36709 was elected leader, sending a full tablet report...
I20260806 18:39:30.154588 19949 raft_consensus.cc:482] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:30.154834 19949 raft_consensus.cc:504] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
W20260806 18:39:30.154982 19695 tablet.cc:2369] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:30.156150 19949 leader_election.cc:288] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3ada8caf4834ee48559ed4d21db9186 (127.12.177.129:37427), 1fed3637d4ca415c9893168e393e322b (127.12.177.131:41657)
I20260806 18:39:30.160883 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.156515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37427 (local address 127.12.177.130:60319)
0806 18:39:30.156667 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:30.156684 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:30.156791 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:30.157212 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:30.157214 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:30.157234 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:30.157389 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:30.157400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.158420 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.158423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:30.159421 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:30.159432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.160389 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.160393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:30.160522 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:30.160551 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:39:30.160636 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 18:39:30.160714 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 18:39:30.160970 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.156673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:60319 (local address 127.12.177.129:37427)
0806 18:39:30.156845 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.156850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.156870 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:39:30.156940 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.156943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.156986 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.157187 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:30.157516 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.158206 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.159586 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.160262 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.160365 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:30.160410 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.160692 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.160773 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 18:39:30.161403 19937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.156988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:35707 (local address 127.12.177.131:41657)
0806 18:39:30.157130 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.157134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.157371 (+ 237us) server_negotiation.cc:407] Connection header received
0806 18:39:30.157574 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.157577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.157619 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.157678 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:30.158013 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.158754 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.160165 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.160771 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.160887 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:30.160952 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.161186 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.161265 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:30.161475 19950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.156807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:41657 (local address 127.12.177.130:35707)
0806 18:39:30.157267 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:30.157284 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:30.157435 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:30.157715 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:30.157718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:30.157738 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:30.157853 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:30.157859 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.158970 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.158980 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:30.160025 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:30.160037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.160931 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.160935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:30.161045 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:30.161078 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 18:39:30.161165 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 18:39:30.161242 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":147,"threads_started":1}
I20260806 18:39:30.161731 19403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ffa75478524ce38d2571b75db22538" candidate_uuid: "b41302453f9a4e9c837cfb7618958cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3ada8caf4834ee48559ed4d21db9186" is_pre_election: true
I20260806 18:39:30.162137 19403 raft_consensus.cc:2454] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b41302453f9a4e9c837cfb7618958cbf in term 0.
I20260806 18:39:30.162429 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ffa75478524ce38d2571b75db22538" candidate_uuid: "b41302453f9a4e9c837cfb7618958cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fed3637d4ca415c9893168e393e322b" is_pre_election: true
I20260806 18:39:30.162752 19840 raft_consensus.cc:2454] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b41302453f9a4e9c837cfb7618958cbf in term 0.
I20260806 18:39:30.162751 19505 leader_election.cc:302] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b41302453f9a4e9c837cfb7618958cbf, c3ada8caf4834ee48559ed4d21db9186; no voters:
I20260806 18:39:30.163069 19949 raft_consensus.cc:2781] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:30.163169 19949 raft_consensus.cc:482] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:30.163218 19949 raft_consensus.cc:3037] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 0 FOLLOWER]: Advancing to term 1
W20260806 18:39:30.163734 19473 tablet.cc:2369] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:30.164434 19949 raft_consensus.cc:504] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.164861 19949 leader_election.cc:288] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [CANDIDATE]: Term 1 election: Requested vote from peers c3ada8caf4834ee48559ed4d21db9186 (127.12.177.129:37427), 1fed3637d4ca415c9893168e393e322b (127.12.177.131:41657)
I20260806 18:39:30.165318 19403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ffa75478524ce38d2571b75db22538" candidate_uuid: "b41302453f9a4e9c837cfb7618958cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3ada8caf4834ee48559ed4d21db9186"
I20260806 18:39:30.165411 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ffa75478524ce38d2571b75db22538" candidate_uuid: "b41302453f9a4e9c837cfb7618958cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fed3637d4ca415c9893168e393e322b"
I20260806 18:39:30.165555 19403 raft_consensus.cc:3037] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:30.165573 19840 raft_consensus.cc:3037] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:30.166721 19403 raft_consensus.cc:2454] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b41302453f9a4e9c837cfb7618958cbf in term 1.
I20260806 18:39:30.166739 19840 raft_consensus.cc:2454] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b41302453f9a4e9c837cfb7618958cbf in term 1.
I20260806 18:39:30.167140 19505 leader_election.cc:302] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fed3637d4ca415c9893168e393e322b, b41302453f9a4e9c837cfb7618958cbf; no voters:
I20260806 18:39:30.167387 19949 raft_consensus.cc:2781] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:30.167690 19949 raft_consensus.cc:686] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 1 LEADER]: Becoming Leader. State: Replica: b41302453f9a4e9c837cfb7618958cbf, State: Running, Role: LEADER
I20260806 18:39:30.168098 19949 consensus_queue.cc:237] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } }
I20260806 18:39:30.171833 19165 catalog_manager.cc:5495] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to b41302453f9a4e9c837cfb7618958cbf (127.12.177.130). New cstate: current_term: 1 leader_uuid: "b41302453f9a4e9c837cfb7618958cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41302453f9a4e9c837cfb7618958cbf" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 } health_report { overall_health: UNKNOWN } } }
W20260806 18:39:30.180248 19917 tablet.cc:2369] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:30.189592 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.185412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38944 (local address 127.12.177.130:44541)
0806 18:39:30.185547 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.185551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.185565 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:30.185701 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.185703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.185759 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.185856 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:30.186100 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.186613 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.187593 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:30.187841 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:30.187938 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:30.188315 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:30.188794 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:30.188899 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.189313 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.189466 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:30.196070 19403 raft_consensus.cc:1261] T c1ffa75478524ce38d2571b75db22538 P c3ada8caf4834ee48559ed4d21db9186 [term 1 FOLLOWER]: Refusing update from remote peer b41302453f9a4e9c837cfb7618958cbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:30.196077 19840 raft_consensus.cc:1261] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 1 FOLLOWER]: Refusing update from remote peer b41302453f9a4e9c837cfb7618958cbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:30.196911 19949 consensus_queue.cc:1035] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3ada8caf4834ee48559ed4d21db9186" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:30.197157 19952 consensus_queue.cc:1035] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fed3637d4ca415c9893168e393e322b" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:30.205868 19958 mvcc.cc:205] Tried to move back new op lower bound from 7315626271514759168 to 7315626271411912704. Current Snapshot: MvccSnapshot[applied={T|T < 7315626271514759168}]
I20260806 18:39:30.209630 19960 mvcc.cc:205] Tried to move back new op lower bound from 7315626271514759168 to 7315626271411912704. Current Snapshot: MvccSnapshot[applied={T|T < 7315626271514759168 or (T in {7315626271514759168})}]
I20260806 18:39:30.216543 19165 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:30.216725 19165 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:30.220189 19165 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d242b7b104b54d96bf4189e00d48051c: Sending DeleteTablet for 3 replicas of tablet c1ffa75478524ce38d2571b75db22538
I20260806 18:39:30.221391 19801 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffa75478524ce38d2571b75db22538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:30 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:59666
I20260806 18:39:30.221349 19373 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffa75478524ce38d2571b75db22538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:30 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:39074
I20260806 18:39:30.221530 19581 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffa75478524ce38d2571b75db22538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:30 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:38934
I20260806 18:39:30.221977 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 19274
I20260806 18:39:30.222246 19982 tablet_replica.cc:330] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: stopping tablet replica
I20260806 18:39:30.225127 19982 raft_consensus.cc:2229] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:30.225831 19982 raft_consensus.cc:2258] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:30.228789 19982 ts_tablet_manager.cc:1905] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:30.232694 19982 ts_tablet_manager.cc:1918] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:30.232847 19982 log.cc:1196] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/c1ffa75478524ce38d2571b75db22538
I20260806 18:39:30.233158 19982 ts_tablet_manager.cc:1939] T c1ffa75478524ce38d2571b75db22538 P b41302453f9a4e9c837cfb7618958cbf: Deleting consensus metadata
I20260806 18:39:30.234848 19978 tablet_replica.cc:330] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: stopping tablet replica
I20260806 18:39:30.234797 19146 catalog_manager.cc:4841] TS b41302453f9a4e9c837cfb7618958cbf (127.12.177.130:44541): tablet c1ffa75478524ce38d2571b75db22538 (table test-table [id=449574c84ffe4074ab4c452c2bb83e38]) successfully deleted
I20260806 18:39:30.235250 19978 raft_consensus.cc:2229] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:30.235632 19978 raft_consensus.cc:2258] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:30.237864 19978 ts_tablet_manager.cc:1905] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 18:39:30.241500 19144 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:37427 (error 108)
I20260806 18:39:30.242425 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 19480
I20260806 18:39:30.242414 19978 ts_tablet_manager.cc:1918] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:30.247001 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.242516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37427 (local address 127.0.0.1:39088)
0806 18:39:30.246735 (+ 4219us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:30.246853 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37427: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4076}
I20260806 18:39:30.251374 19978 log.cc:1196] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/c1ffa75478524ce38d2571b75db22538
W20260806 18:39:30.251434 19144 catalog_manager.cc:4584] TS c3ada8caf4834ee48559ed4d21db9186 (127.12.177.129:37427): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1ffa75478524ce38d2571b75db22538: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37427: connect: Connection refused (error 111)
I20260806 18:39:30.251937 19978 ts_tablet_manager.cc:1939] T c1ffa75478524ce38d2571b75db22538 P 1fed3637d4ca415c9893168e393e322b: Deleting consensus metadata
I20260806 18:39:30.253611 19144 catalog_manager.cc:4841] TS 1fed3637d4ca415c9893168e393e322b (127.12.177.131:41657): tablet c1ffa75478524ce38d2571b75db22538 (table test-table [id=449574c84ffe4074ab4c452c2bb83e38]) successfully deleted
I20260806 18:39:30.262187 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 19702
I20260806 18:39:30.292503 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 19123
2026-08-06T18:39:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2846 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T18:39:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:30Z Disabled control of system clock
I20260806 18:39:30.335141 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37007
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:44503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 18:39:30.454320 19987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:30.454756 19987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:30.454870 19987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:30.460064 19987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:30.460206 19987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:30.460237 19987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:30.460280 19987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:30.460316 19987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:30.469107 19987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37007
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:30.470402 19987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:30.472261 19987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:30.481745 19997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:30.481745 19992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:30.481745 19993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:30.482048 19987 server_base.cc:1034] running on GCE node
I20260806 18:39:30.482875 19987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:30.484278 19987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:30.485491 19987 hybrid_clock.cc:648] HybridClock initialized: now 1786041570485470 us; error 38 us; skew 500 ppm
I20260806 18:39:30.487838 19987 webserver.cc:460] Webserver started at http://127.12.177.190:39961/ using document root <none> and password file <none>
I20260806 18:39:30.488541 19987 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:30.488649 19987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:30.488916 19987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:30.491534 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "b525197ee4ef46498669f9e75f4f5c7e"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "f32b3f587d4c7a9eeecacc1aafc7b29c"
server_key_iv: "ad1ab886cfe8592e73d2b6abef85397b"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.492182 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "b525197ee4ef46498669f9e75f4f5c7e"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "f32b3f587d4c7a9eeecacc1aafc7b29c"
server_key_iv: "ad1ab886cfe8592e73d2b6abef85397b"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.496469 19987 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:30.499282 20007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.500677 19987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:30.500851 19987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "b525197ee4ef46498669f9e75f4f5c7e"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "f32b3f587d4c7a9eeecacc1aafc7b29c"
server_key_iv: "ad1ab886cfe8592e73d2b6abef85397b"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.500990 19987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:30.506106 19987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:30.506845 19987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:30.507061 19987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:30.515077 19987 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:37007
I20260806 18:39:30.515152 20079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:37007 every 8 connection(s)
I20260806 18:39:30.516261 19987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:30.520303 20080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:30.522363 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 19987
I20260806 18:39:30.522527 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:30.522815 12998 external_mini_cluster.cc:1428] Setting key d9011572576650b4c4e0e63085ed98b6
I20260806 18:39:30.528381 20080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: Bootstrap starting.
I20260806 18:39:30.529446 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.524663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.12.177.190:37007)
0806 18:39:30.525459 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.525477 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.525519 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:39:30.526256 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.526274 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.526666 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.526994 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:30.527955 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:30.527961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:30.527973 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:30.527985 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:30.528045 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:30.528063 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:30.528183 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.528308 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.528597 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":171,"threads_started":1}
I20260806 18:39:30.531309 20080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:30.532255 20080 log.cc:824] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:30.534672 20080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: No bootstrap required, opened a new log
I20260806 18:39:30.538872 20080 raft_consensus.cc:348] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } }
I20260806 18:39:30.539182 20080 raft_consensus.cc:374] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:30.539279 20080 raft_consensus.cc:729] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b525197ee4ef46498669f9e75f4f5c7e, State: Initialized, Role: FOLLOWER
I20260806 18:39:30.539767 20080 consensus_queue.cc:260] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } }
I20260806 18:39:30.539950 20080 raft_consensus.cc:388] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:30.540086 20080 raft_consensus.cc:482] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:30.540225 20080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:30.541327 20080 raft_consensus.cc:504] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } }
I20260806 18:39:30.541800 20080 leader_election.cc:302] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b525197ee4ef46498669f9e75f4f5c7e; no voters:
I20260806 18:39:30.542194 20080 leader_election.cc:288] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:30.542367 20085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:30.542634 20085 raft_consensus.cc:686] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [term 1 LEADER]: Becoming Leader. State: Replica: b525197ee4ef46498669f9e75f4f5c7e, State: Running, Role: LEADER
I20260806 18:39:30.542979 20085 consensus_queue.cc:237] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } }
I20260806 18:39:30.543679 20080 sys_catalog.cc:564] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:30.544775 20088 sys_catalog.cc:455] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b525197ee4ef46498669f9e75f4f5c7e. Latest consensus state: current_term: 1 leader_uuid: "b525197ee4ef46498669f9e75f4f5c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } } }
I20260806 18:39:30.544926 20088 sys_catalog.cc:458] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:30.545373 20086 sys_catalog.cc:455] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b525197ee4ef46498669f9e75f4f5c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b525197ee4ef46498669f9e75f4f5c7e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37007 } } }
I20260806 18:39:30.545550 20086 sys_catalog.cc:458] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:30.545923 20103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:30.549307 20103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:30.555867 20103 catalog_manager.cc:1347] Generated new cluster ID: 76897915086d421c8377d6e218f49312
I20260806 18:39:30.555972 20103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:30.568238 20103 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:30.568645 20103 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:30.573794 20103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: Generated new TSK 0
I20260806 18:39:30.574601 20103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:39:30.580127 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--builtin_ntp_servers=127.12.177.148:44503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 18:39:30.708135 20118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:30.708494 20118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:30.708568 20118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:30.712931 20118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:30.713058 20118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:30.713171 20118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:30.718741 20118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:30.720178 20118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:30.721700 20118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:30.732707 20128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:30.732689 20130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:30.732971 20118 server_base.cc:1034] running on GCE node
W20260806 18:39:30.733105 20132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:30.733639 20118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:30.734405 20118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:30.735581 20118 hybrid_clock.cc:648] HybridClock initialized: now 1786041570735556 us; error 38 us; skew 500 ppm
I20260806 18:39:30.738092 20118 webserver.cc:460] Webserver started at http://127.12.177.129:41795/ using document root <none> and password file <none>
I20260806 18:39:30.738786 20118 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:30.738893 20118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:30.739164 20118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:30.741895 20118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "9964dcaf06c145468c3a205d1aa720ac"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "c0a7344fa36687e9d9ae7c99481e9248"
server_key_iv: "11732e235c10568ad16bb00c06689c75"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.742591 20118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "9964dcaf06c145468c3a205d1aa720ac"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "c0a7344fa36687e9d9ae7c99481e9248"
server_key_iv: "11732e235c10568ad16bb00c06689c75"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.747118 20118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:30.750460 20139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.751924 20118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:30.752110 20118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "9964dcaf06c145468c3a205d1aa720ac"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "c0a7344fa36687e9d9ae7c99481e9248"
server_key_iv: "11732e235c10568ad16bb00c06689c75"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.752264 20118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:30.757624 20118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:30.758407 20118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:30.758621 20118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:30.759231 20118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:30.760231 20118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:30.760308 20118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.760381 20118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:30.760425 20118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.770470 20118 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37501
I20260806 18:39:30.770509 20313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37501 every 8 connection(s)
I20260806 18:39:30.771522 20118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:30.778563 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.773653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:53669 (local address 127.12.177.190:37007)
0806 18:39:30.773826 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.773831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.775154 (+ 1323us) server_negotiation.cc:407] Connection header received
0806 18:39:30.776758 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.776761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.776806 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.776900 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:30.778127 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:30.778130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:30.778132 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:30.778145 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:30.778166 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:30.778174 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:30.778258 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.778397 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.778440 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 18:39:30.778826 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 20118
I20260806 18:39:30.778961 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:30.779279 12998 external_mini_cluster.cc:1428] Setting key ea8d1e65894cadc3f38456b36234b862
I20260806 18:39:30.779932 20317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.774190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37007 (local address 127.12.177.129:53669)
0806 18:39:30.774968 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:30.775017 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:30.776513 (+ 1496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:30.777072 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:30.777079 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:30.777179 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:30.777852 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:30.777854 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:30.777899 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:30.777975 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:30.778255 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:30.778262 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:30.778267 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 18:39:30.778411 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 18:39:30.778856 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260806 18:39:30.781291 20314 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37007
I20260806 18:39:30.781605 20314 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:30.781667 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--builtin_ntp_servers=127.12.177.148:44503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 18:39:30.782142 20314 heartbeater.cc:511] Master 127.12.177.190:37007 requested a full tablet report, sending...
I20260806 18:39:30.784142 20028 ts_manager.cc:194] Registered new tserver with Master: 9964dcaf06c145468c3a205d1aa720ac (127.12.177.129:37501)
W20260806 18:39:30.904717 20319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:30.905068 20319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:30.905144 20319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:30.909279 20319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:30.909372 20319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:30.909433 20319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:30.914494 20319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:30.915774 20319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:30.917361 20319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:30.928764 20333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:30.928887 20329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:30.928817 20327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:30.928781 20319 server_base.cc:1034] running on GCE node
I20260806 18:39:30.929636 20319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:30.930418 20319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:30.931654 20319 hybrid_clock.cc:648] HybridClock initialized: now 1786041570931631 us; error 47 us; skew 500 ppm
I20260806 18:39:30.933969 20319 webserver.cc:460] Webserver started at http://127.12.177.130:38849/ using document root <none> and password file <none>
I20260806 18:39:30.934643 20319 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:30.934767 20319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:30.935022 20319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:30.937430 20319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "255b6de93f4f4298b851926b7fbaace2"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "1bbec7aa7eef2a3045e1e339a4c0018d"
server_key_iv: "cac5c48872e32c48ff44ddbcca502ff3"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.938130 20319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "255b6de93f4f4298b851926b7fbaace2"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "1bbec7aa7eef2a3045e1e339a4c0018d"
server_key_iv: "cac5c48872e32c48ff44ddbcca502ff3"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.942787 20319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:30.946125 20344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.947708 20319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:30.947870 20319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "255b6de93f4f4298b851926b7fbaace2"
format_stamp: "Formatted at 2026-08-06 18:39:30 on dist-test-slave-j2vl"
server_key: "1bbec7aa7eef2a3045e1e339a4c0018d"
server_key_iv: "cac5c48872e32c48ff44ddbcca502ff3"
server_key_version: "encryptionkey@0"
I20260806 18:39:30.948025 20319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:30.953208 20319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:30.953928 20319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:30.954128 20319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:30.954731 20319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:30.955729 20319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:30.955786 20319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.955873 20319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:30.955910 20319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:30.965665 20319 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:43853
I20260806 18:39:30.965687 20506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:43853 every 8 connection(s)
I20260806 18:39:30.966686 20319 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:30.970795 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 20319
I20260806 18:39:30.970942 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:30.971251 12998 external_mini_cluster.cc:1428] Setting key 3194ed8054c5001a6fcbc9138eea2ba7
I20260806 18:39:30.973529 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.968791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:39711 (local address 127.12.177.190:37007)
0806 18:39:30.968950 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:30.968954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:30.970080 (+ 1126us) server_negotiation.cc:407] Connection header received
0806 18:39:30.971523 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:30.971527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:30.971576 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:30.971676 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:30.972974 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:30.972978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:30.972981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:30.973001 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:30.973021 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:30.973030 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:30.973131 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:30.973301 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 18:39:30.973389 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:39:30.973739 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--builtin_ntp_servers=127.12.177.148:44503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 18:39:30.974594 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:30.969151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37007 (local address 127.12.177.130:39711)
0806 18:39:30.969903 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:30.969946 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:30.971267 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:30.971865 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:30.971873 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:30.971989 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:30.972622 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:30.972624 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:30.972668 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:30.972784 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:30.973121 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:30.973131 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:30.973139 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:39:30.973342 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 18:39:30.973689 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":142,"threads_started":1}
I20260806 18:39:30.976583 20507 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37007
I20260806 18:39:30.976878 20507 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:30.977440 20507 heartbeater.cc:511] Master 127.12.177.190:37007 requested a full tablet report, sending...
I20260806 18:39:30.978794 20028 ts_manager.cc:194] Registered new tserver with Master: 255b6de93f4f4298b851926b7fbaace2 (127.12.177.130:43853)
W20260806 18:39:31.096589 20513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:31.096930 20513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:31.096973 20513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:31.101230 20513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:31.101393 20513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:31.101501 20513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:31.106771 20513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:31.108029 20513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:31.109524 20513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:31.120914 20525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:31.120905 20527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:31.120901 20523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:31.120985 20513 server_base.cc:1034] running on GCE node
I20260806 18:39:31.121711 20513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:31.122498 20513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:31.123729 20513 hybrid_clock.cc:648] HybridClock initialized: now 1786041571123713 us; error 32 us; skew 500 ppm
I20260806 18:39:31.126278 20513 webserver.cc:460] Webserver started at http://127.12.177.131:40463/ using document root <none> and password file <none>
I20260806 18:39:31.127429 20513 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:31.127561 20513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:31.127771 20513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:31.130250 20513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "4689712b29e34f528f0fd52783a554ea"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "752a85425780df1decfbe7a820e78317"
server_key_iv: "adf27be4545e98c8d68e3f58032f0309"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.130873 20513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "4689712b29e34f528f0fd52783a554ea"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "752a85425780df1decfbe7a820e78317"
server_key_iv: "adf27be4545e98c8d68e3f58032f0309"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.135281 20513 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:31.138455 20535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:31.140247 20513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:31.140441 20513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "4689712b29e34f528f0fd52783a554ea"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "752a85425780df1decfbe7a820e78317"
server_key_iv: "adf27be4545e98c8d68e3f58032f0309"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.140599 20513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:31.146037 20513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:31.147122 20513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:31.147378 20513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:31.148072 20513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:31.149148 20513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:31.149225 20513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:31.149298 20513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:31.149338 20513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:31.159719 20513 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:37699
I20260806 18:39:31.159744 20703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:37699 every 8 connection(s)
I20260806 18:39:31.160842 20513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:31.162731 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 20513
I20260806 18:39:31.162875 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:31.163235 12998 external_mini_cluster.cc:1428] Setting key 5f00af687daaf537c6d1cd820acda93d
I20260806 18:39:31.167742 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.163152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:41053 (local address 127.12.177.190:37007)
0806 18:39:31.163353 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.163358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.164687 (+ 1329us) server_negotiation.cc:407] Connection header received
0806 18:39:31.166146 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.166149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.166187 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.166258 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.167394 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.167396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.167398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.167407 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.167423 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.167430 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.167515 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.167597 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.167633 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:39:31.168705 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.163717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37007 (local address 127.12.177.131:41053)
0806 18:39:31.164534 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.164592 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.165929 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.166397 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.166405 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.166500 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.167141 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.167143 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.167188 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.167263 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.167502 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.167507 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.167511 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.167639 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.167845 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":146,"threads_started":1}
I20260806 18:39:31.169922 20704 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37007
I20260806 18:39:31.170192 20704 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:31.170706 20704 heartbeater.cc:511] Master 127.12.177.190:37007 requested a full tablet report, sending...
I20260806 18:39:31.171890 20028 ts_manager.cc:194] Registered new tserver with Master: 4689712b29e34f528f0fd52783a554ea (127.12.177.131:37699)
I20260806 18:39:31.178359 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:39:31.182706 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.180748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.12.177.190:37007)
0806 18:39:31.180952 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.180958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.181119 (+ 161us) server_negotiation.cc:407] Connection header received
0806 18:39:31.181294 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.181298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.181395 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.181505 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.182249 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.182253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.182256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.182270 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.182298 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.182307 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.182410 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.182494 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.182540 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 18:39:31.186086 20028 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:31.189586 20028 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:31.202522 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.200276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.12.177.131:37699)
0806 18:39:31.200789 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.200804 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.200830 (+ 26us) server_negotiation.cc:407] Connection header received
0806 18:39:31.200884 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.200889 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.201076 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.201225 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.201933 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.201938 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.201948 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.201957 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.201991 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.202008 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.202136 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.202282 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.202358 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":197,"threads_started":1}
I20260806 18:39:31.202510 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.199747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37699 (local address 127.0.0.1:34090)
0806 18:39:31.200296 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.200310 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.200387 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.201243 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.201245 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.201259 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.201787 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.201789 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.201798 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.201818 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.202108 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.202118 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.202125 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.202268 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.202346 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":105,"threads_started":1}
I20260806 18:39:31.202541 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.198959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37501 (local address 127.0.0.1:37158)
0806 18:39:31.199609 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.199666 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.199772 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.200439 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.200446 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.200527 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.201639 (+ 1112us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.201641 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.201653 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.201683 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.202246 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.202250 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.202253 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.202338 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.202378 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":111,"threads_started":1}
I20260806 18:39:31.202877 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.199027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43853 (local address 127.0.0.1:47066)
0806 18:39:31.199847 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.199862 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.199948 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.200998 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.201000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.201015 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.201524 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.201526 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.201551 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.201634 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.202647 (+ 1013us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.202654 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.202658 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.202735 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.202769 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":125,"threads_started":1}
I20260806 18:39:31.203213 20727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.199084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37158 (local address 127.12.177.129:37501)
0806 18:39:31.199930 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.199943 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.199972 (+ 29us) server_negotiation.cc:407] Connection header received
0806 18:39:31.200034 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.200040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.200255 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.201508 (+ 1253us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.202080 (+ 572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.202084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.202091 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.202098 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.202126 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.202140 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.202276 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.202744 (+ 468us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.202820 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":100,"threads_started":1}
I20260806 18:39:31.203302 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.199427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.12.177.130:43853)
0806 18:39:31.200217 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.200228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.200251 (+ 23us) server_negotiation.cc:407] Connection header received
0806 18:39:31.200306 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.200326 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.200515 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.200653 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.202371 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.202377 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.202397 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.202410 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.202460 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.202493 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.202603 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.203061 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.203136 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":115,"threads_started":1}
I20260806 18:39:31.206127 20417 tablet_service.cc:1467] Processing CreateTablet for tablet 50679e87b76e435ca0ee5a03344c0746 (DEFAULT_TABLE table=test-table [id=0286114c71fb496780bb2ae2b2d25d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:31.206139 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 50679e87b76e435ca0ee5a03344c0746 (DEFAULT_TABLE table=test-table [id=0286114c71fb496780bb2ae2b2d25d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:31.206139 20211 tablet_service.cc:1467] Processing CreateTablet for tablet 50679e87b76e435ca0ee5a03344c0746 (DEFAULT_TABLE table=test-table [id=0286114c71fb496780bb2ae2b2d25d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:31.207255 20417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50679e87b76e435ca0ee5a03344c0746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:31.207260 20211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50679e87b76e435ca0ee5a03344c0746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:31.207261 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50679e87b76e435ca0ee5a03344c0746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:31.214923 20732 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Bootstrap starting.
I20260806 18:39:31.216099 20734 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Bootstrap starting.
I20260806 18:39:31.216518 20733 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Bootstrap starting.
I20260806 18:39:31.217783 20732 tablet_bootstrap.cc:654] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:31.218509 20734 tablet_bootstrap.cc:654] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:31.218637 20732 log.cc:824] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:31.218696 20733 tablet_bootstrap.cc:654] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:31.219447 20733 log.cc:824] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:31.219447 20734 log.cc:824] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:31.220875 20732 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: No bootstrap required, opened a new log
I20260806 18:39:31.221113 20732 ts_tablet_manager.cc:1397] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:39:31.221441 20733 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: No bootstrap required, opened a new log
I20260806 18:39:31.221733 20733 ts_tablet_manager.cc:1397] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 18:39:31.222378 20734 tablet_bootstrap.cc:492] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: No bootstrap required, opened a new log
I20260806 18:39:31.222641 20734 ts_tablet_manager.cc:1397] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:39:31.225730 20732 raft_consensus.cc:348] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.226054 20732 raft_consensus.cc:374] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:31.226136 20732 raft_consensus.cc:729] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b6de93f4f4298b851926b7fbaace2, State: Initialized, Role: FOLLOWER
I20260806 18:39:31.226678 20732 consensus_queue.cc:260] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.227486 20507 heartbeater.cc:503] Master 127.12.177.190:37007 was elected leader, sending a full tablet report...
I20260806 18:39:31.227484 20733 raft_consensus.cc:348] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.227770 20733 raft_consensus.cc:374] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:31.227851 20733 raft_consensus.cc:729] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9964dcaf06c145468c3a205d1aa720ac, State: Initialized, Role: FOLLOWER
I20260806 18:39:31.227907 20732 ts_tablet_manager.cc:1428] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:39:31.228123 20734 raft_consensus.cc:348] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.228353 20733 consensus_queue.cc:260] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.228487 20734 raft_consensus.cc:374] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:31.228582 20734 raft_consensus.cc:729] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4689712b29e34f528f0fd52783a554ea, State: Initialized, Role: FOLLOWER
I20260806 18:39:31.229105 20734 consensus_queue.cc:260] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.229527 20733 ts_tablet_manager.cc:1428] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 18:39:31.229928 20314 heartbeater.cc:503] Master 127.12.177.190:37007 was elected leader, sending a full tablet report...
I20260806 18:39:31.229987 20704 heartbeater.cc:503] Master 127.12.177.190:37007 was elected leader, sending a full tablet report...
I20260806 18:39:31.230144 20734 ts_tablet_manager.cc:1428] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:39:31.253582 20741 raft_consensus.cc:482] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:31.253803 20741 raft_consensus.cc:504] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.255028 20741 leader_election.cc:288] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b6de93f4f4298b851926b7fbaace2 (127.12.177.130:43853), 4689712b29e34f528f0fd52783a554ea (127.12.177.131:37699)
I20260806 18:39:31.256992 20317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.255249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43853 (local address 127.12.177.129:51283)
0806 18:39:31.255433 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.255449 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.255549 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.255805 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.255808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.255823 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.256380 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.256381 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.256392 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.256417 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.256737 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.256740 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.256743 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.256822 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.256859 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 18:39:31.257002 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.255464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:51283 (local address 127.12.177.130:43853)
0806 18:39:31.255599 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.255605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.255620 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:31.255668 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.255671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.255709 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.255783 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.256603 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.256609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.256615 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.256628 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.256654 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.256665 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.256754 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.256818 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.256859 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:31.257503 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.255563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:35445 (local address 127.12.177.131:37699)
0806 18:39:31.255731 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.255738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.255893 (+ 155us) server_negotiation.cc:407] Connection header received
0806 18:39:31.256110 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.256112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.256148 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.256267 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.257017 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.257020 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.257023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.257035 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.257057 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.257070 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.257146 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.257323 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.257385 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 18:39:31.257519 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.255306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37699 (local address 127.12.177.129:35445)
0806 18:39:31.255800 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.255815 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.255954 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.256301 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.256307 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.256326 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:31.256791 (+ 465us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:39:31.256793 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:31.256826 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:39:31.256867 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:31.257224 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:31.257227 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:31.257229 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 18:39:31.257299 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 18:39:31.257370 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":120,"threads_started":1}
I20260806 18:39:31.257840 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50679e87b76e435ca0ee5a03344c0746" candidate_uuid: "9964dcaf06c145468c3a205d1aa720ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b6de93f4f4298b851926b7fbaace2" is_pre_election: true
I20260806 18:39:31.258131 20634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50679e87b76e435ca0ee5a03344c0746" candidate_uuid: "9964dcaf06c145468c3a205d1aa720ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4689712b29e34f528f0fd52783a554ea" is_pre_election: true
I20260806 18:39:31.258208 20445 raft_consensus.cc:2454] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9964dcaf06c145468c3a205d1aa720ac in term 0.
I20260806 18:39:31.258416 20634 raft_consensus.cc:2454] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9964dcaf06c145468c3a205d1aa720ac in term 0.
I20260806 18:39:31.258698 20144 leader_election.cc:302] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b6de93f4f4298b851926b7fbaace2, 9964dcaf06c145468c3a205d1aa720ac; no voters:
I20260806 18:39:31.259042 20741 raft_consensus.cc:2781] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:31.259140 20741 raft_consensus.cc:482] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:31.259186 20741 raft_consensus.cc:3037] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:31.260281 20741 raft_consensus.cc:504] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.260654 20741 leader_election.cc:288] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [CANDIDATE]: Term 1 election: Requested vote from peers 255b6de93f4f4298b851926b7fbaace2 (127.12.177.130:43853), 4689712b29e34f528f0fd52783a554ea (127.12.177.131:37699)
I20260806 18:39:31.260998 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50679e87b76e435ca0ee5a03344c0746" candidate_uuid: "9964dcaf06c145468c3a205d1aa720ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b6de93f4f4298b851926b7fbaace2"
I20260806 18:39:31.261117 20634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50679e87b76e435ca0ee5a03344c0746" candidate_uuid: "9964dcaf06c145468c3a205d1aa720ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4689712b29e34f528f0fd52783a554ea"
I20260806 18:39:31.261111 20445 raft_consensus.cc:3037] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:31.261270 20634 raft_consensus.cc:3037] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:31.262290 20445 raft_consensus.cc:2454] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9964dcaf06c145468c3a205d1aa720ac in term 1.
I20260806 18:39:31.262374 20634 raft_consensus.cc:2454] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9964dcaf06c145468c3a205d1aa720ac in term 1.
I20260806 18:39:31.262593 20144 leader_election.cc:302] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b6de93f4f4298b851926b7fbaace2, 9964dcaf06c145468c3a205d1aa720ac; no voters:
I20260806 18:39:31.262810 20741 raft_consensus.cc:2781] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:31.263002 20741 raft_consensus.cc:686] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [term 1 LEADER]: Becoming Leader. State: Replica: 9964dcaf06c145468c3a205d1aa720ac, State: Running, Role: LEADER
I20260806 18:39:31.263355 20741 consensus_queue.cc:237] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } }
I20260806 18:39:31.267136 20028 catalog_manager.cc:5495] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 9964dcaf06c145468c3a205d1aa720ac (127.12.177.129). New cstate: current_term: 1 leader_uuid: "9964dcaf06c145468c3a205d1aa720ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9964dcaf06c145468c3a205d1aa720ac" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 } health_report { overall_health: UNKNOWN } } }
W20260806 18:39:31.272791 20315 tablet.cc:2369] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:31.291903 20727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.290167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.12.177.129:37501)
0806 18:39:31.290319 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.290322 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.290337 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:31.290493 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.290497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.290571 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.290645 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.291395 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.291399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.291401 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.291413 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.291434 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.291442 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.291536 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.291648 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.291684 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:31.298310 20445 raft_consensus.cc:1261] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 1 FOLLOWER]: Refusing update from remote peer 9964dcaf06c145468c3a205d1aa720ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:31.298326 20634 raft_consensus.cc:1261] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 1 FOLLOWER]: Refusing update from remote peer 9964dcaf06c145468c3a205d1aa720ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:31.299122 20741 consensus_queue.cc:1035] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b6de93f4f4298b851926b7fbaace2" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:31.299360 20745 consensus_queue.cc:1035] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "4689712b29e34f528f0fd52783a554ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:31.309754 20750 mvcc.cc:205] Tried to move back new op lower bound from 7315626276029988864 to 7315626275897593856. Current Snapshot: MvccSnapshot[applied={T|T < 7315626276029988864 or (T in {7315626276029988864})}]
I20260806 18:39:31.319262 20033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:31.319517 20033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:31.322450 20033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b525197ee4ef46498669f9e75f4f5c7e: Sending DeleteTablet for 3 replicas of tablet 50679e87b76e435ca0ee5a03344c0746
I20260806 18:39:31.323572 20603 tablet_service.cc:1514] Processing DeleteTablet for tablet 50679e87b76e435ca0ee5a03344c0746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:31 UTC) from {username='slave'} at 127.0.0.1:34090
I20260806 18:39:31.323724 20417 tablet_service.cc:1514] Processing DeleteTablet for tablet 50679e87b76e435ca0ee5a03344c0746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:31 UTC) from {username='slave'} at 127.0.0.1:47066
I20260806 18:39:31.324232 20760 tablet_replica.cc:330] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: stopping tablet replica
I20260806 18:39:31.324270 20211 tablet_service.cc:1514] Processing DeleteTablet for tablet 50679e87b76e435ca0ee5a03344c0746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:31 UTC) from {username='slave'} at 127.0.0.1:37158
I20260806 18:39:31.324841 20765 tablet_replica.cc:330] T 50679e87b76e435ca0ee5a03344c0746 P 9964dcaf06c145468c3a205d1aa720ac: stopping tablet replica
I20260806 18:39:31.324908 20763 tablet_replica.cc:330] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: stopping tablet replica
I20260806 18:39:31.325052 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 20118
I20260806 18:39:31.325786 20763 raft_consensus.cc:2229] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:31.326665 20763 raft_consensus.cc:2258] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:31.329216 20760 raft_consensus.cc:2229] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:31.329759 20760 raft_consensus.cc:2258] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:31.331373 20760 ts_tablet_manager.cc:1905] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:31.331413 20763 ts_tablet_manager.cc:1905] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:31.333916 20760 ts_tablet_manager.cc:1918] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:31.334067 20760 log.cc:1196] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/50679e87b76e435ca0ee5a03344c0746
I20260806 18:39:31.334417 20760 ts_tablet_manager.cc:1939] T 50679e87b76e435ca0ee5a03344c0746 P 4689712b29e34f528f0fd52783a554ea: Deleting consensus metadata
I20260806 18:39:31.335259 20763 ts_tablet_manager.cc:1918] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:31.335382 20763 log.cc:1196] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/50679e87b76e435ca0ee5a03344c0746
I20260806 18:39:31.335873 20763 ts_tablet_manager.cc:1939] T 50679e87b76e435ca0ee5a03344c0746 P 255b6de93f4f4298b851926b7fbaace2: Deleting consensus metadata
I20260806 18:39:31.336035 20012 catalog_manager.cc:4841] TS 4689712b29e34f528f0fd52783a554ea (127.12.177.131:37699): tablet 50679e87b76e435ca0ee5a03344c0746 (table test-table [id=0286114c71fb496780bb2ae2b2d25d8b]) successfully deleted
I20260806 18:39:31.337364 20013 catalog_manager.cc:4841] TS 255b6de93f4f4298b851926b7fbaace2 (127.12.177.130:43853): tablet 50679e87b76e435ca0ee5a03344c0746 (table test-table [id=0286114c71fb496780bb2ae2b2d25d8b]) successfully deleted
W20260806 18:39:31.337777 20012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:37501 (error 108)
I20260806 18:39:31.338050 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 20319
I20260806 18:39:31.345186 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.344774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37501 (local address 127.0.0.1:37170)
0806 18:39:31.344973 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.345086 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 18:39:31.345438 20012 catalog_manager.cc:4584] TS 9964dcaf06c145468c3a205d1aa720ac (127.12.177.129:37501): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 50679e87b76e435ca0ee5a03344c0746: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37501: connect: Connection refused (error 111)
I20260806 18:39:31.350660 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 20513
I20260806 18:39:31.369807 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 19987
2026-08-06T18:39:31Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1074 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 18:39:31.399462 12998 mini_oidc.cc:152] Starting JWKS server
I20260806 18:39:31.401239 12998 webserver.cc:460] Webserver started at https://127.0.0.1:39511/ using document root <none> and password file <none>
I20260806 18:39:31.401538 12998 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 18:39:31.401865 12998 webserver.cc:460] Webserver started at http://127.0.0.1:36605/ using document root <none> and password file <none>
2026-08-06T18:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:31Z Disabled control of system clock
I20260806 18:39:31.412987 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35219
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:45635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35219
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39511/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/testchainca.cert with env {}
W20260806 18:39:31.533291 20777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:31.533627 20777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:31.533671 20777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:31.537734 20777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:31.537793 20777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:31.537808 20777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:31.537825 20777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:31.537842 20777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 18:39:31.537858 20777 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 18:39:31.537870 20777 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39511/jwks.json
I20260806 18:39:31.543658 20777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39511/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:31.544770 20777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:31.545761 20777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:31.555346 20782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:31.555354 20788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:31.555419 20777 server_base.cc:1034] running on GCE node
W20260806 18:39:31.555354 20786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:31.556290 20777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:31.557699 20777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:31.558911 20777 hybrid_clock.cc:648] HybridClock initialized: now 1786041571558875 us; error 59 us; skew 500 ppm
I20260806 18:39:31.561249 20777 webserver.cc:460] Webserver started at http://127.12.177.190:37879/ using document root <none> and password file <none>
I20260806 18:39:31.561944 20777 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:31.562018 20777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:31.562202 20777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:31.564407 20777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "029e66e67bac4d26a02c6fb194dfca8b"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "716f5cec0514c73766c3a5454b50ccb7"
server_key_iv: "db9ffe471714db684a954a42d0ea20cb"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.564980 20777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "029e66e67bac4d26a02c6fb194dfca8b"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "716f5cec0514c73766c3a5454b50ccb7"
server_key_iv: "db9ffe471714db684a954a42d0ea20cb"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.569046 20777 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:39:31.571803 20799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:31.573268 20777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:31.573478 20777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "029e66e67bac4d26a02c6fb194dfca8b"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "716f5cec0514c73766c3a5454b50ccb7"
server_key_iv: "db9ffe471714db684a954a42d0ea20cb"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.573609 20777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:31.594103 20777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:31.594996 20777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:31.595232 20777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:31.603993 20777 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35219
I20260806 18:39:31.604019 20873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35219 every 8 connection(s)
I20260806 18:39:31.605274 20777 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:31.609086 20874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:31.610483 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 20777
I20260806 18:39:31.610590 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:31.610909 12998 external_mini_cluster.cc:1428] Setting key 5b4576c62f3eed1d4ce98f6f617ae69d
I20260806 18:39:31.616772 20874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b: Bootstrap starting.
I20260806 18:39:31.619673 20874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:31.620631 20874 log.cc:824] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:31.622646 20877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.612584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39592 (local address 127.12.177.190:35219)
0806 18:39:31.613395 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.613419 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.613486 (+ 67us) server_negotiation.cc:407] Connection header received
0806 18:39:31.614372 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.614398 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.614980 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.615404 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.615913 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.617389 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.618424 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.619124 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.619298 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:31.620206 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.620212 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.620231 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.620819 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.620896 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.620925 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.621043 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.621244 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.621638 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":139,"threads_started":1}
I20260806 18:39:31.623283 20874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b: No bootstrap required, opened a new log
I20260806 18:39:31.625773 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:39:31.627626 20874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } }
I20260806 18:39:31.627874 20874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:31.627944 20874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 029e66e67bac4d26a02c6fb194dfca8b, State: Initialized, Role: FOLLOWER
I20260806 18:39:31.628427 20874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } }
I20260806 18:39:31.628571 20874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:31.628669 20874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:31.628798 20874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:31.629992 20874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } }
I20260806 18:39:31.630398 20874 leader_election.cc:302] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 029e66e67bac4d26a02c6fb194dfca8b; no voters:
I20260806 18:39:31.630774 20874 leader_election.cc:288] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:31.631067 20879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:31.631294 20879 raft_consensus.cc:686] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [term 1 LEADER]: Becoming Leader. State: Replica: 029e66e67bac4d26a02c6fb194dfca8b, State: Running, Role: LEADER
I20260806 18:39:31.631633 20879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } }
I20260806 18:39:31.632177 20874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:31.633493 20880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "029e66e67bac4d26a02c6fb194dfca8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } } }
I20260806 18:39:31.633651 20880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:31.633948 20882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 029e66e67bac4d26a02c6fb194dfca8b. Latest consensus state: current_term: 1 leader_uuid: "029e66e67bac4d26a02c6fb194dfca8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029e66e67bac4d26a02c6fb194dfca8b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35219 } } }
I20260806 18:39:31.634065 20882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:31.634400 20890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:31.637789 20890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:31.646104 20890 catalog_manager.cc:1347] Generated new cluster ID: 772c43d3c8be4a3ea4d18b716f568e79
I20260806 18:39:31.646222 20890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:31.656819 20890 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:31.658452 20890 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:31.666167 20890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 029e66e67bac4d26a02c6fb194dfca8b: Generated new TSK 0
I20260806 18:39:31.667136 20890 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 18:39:31.699194 20915 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 18:39:31.699369 20915 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 18:39:31.700070 20877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.682549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39602 (local address 127.12.177.190:35219)
0806 18:39:31.682688 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.682692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.682884 (+ 192us) server_negotiation.cc:407] Connection header received
0806 18:39:31.683169 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.683178 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.683234 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.683345 (+ 111us) server_negotiation.cc:226] Negotiated authn=JWT
0806 18:39:31.683632 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.684230 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.685148 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.685499 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.685620 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:31.686036 (+ 416us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 18:39:31.699542 (+ 13506us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 18:39:31.699898 (+ 356us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 18:39:31.700150 20877 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 18:39:31.701400 20913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:31.682418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35219 (local address 127.0.0.1:39602)
0806 18:39:31.682784 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:31.682800 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:31.682966 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:31.683376 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:31.683380 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:31.683388 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 18:39:31.683517 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:31.683523 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.684366 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.684370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:31.685007 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:31.685015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.685633 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.685638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:31.685742 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:31.685798 (+ 56us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 18:39:31.699815 (+ 14017us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 18:39:31.700080 (+ 265us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.177.190:35219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":130,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.177.190:35219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39511/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 18:39:31.702188 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 20777
2026-08-06T18:39:31Z chronyd exiting
I20260806 18:39:31.745676 12998 test_util.cc:175] -----------------------------------------------
I20260806 18:39:31.745774 12998 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786041540454168-12998-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (348 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 18:39:31.747057 12998 mini_oidc.cc:152] Starting JWKS server
I20260806 18:39:31.747954 12998 webserver.cc:460] Webserver started at https://127.0.0.1:42119/ using document root <none> and password file <none>
I20260806 18:39:31.748056 12998 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 18:39:31.748271 12998 webserver.cc:460] Webserver started at http://127.0.0.1:40661/ using document root <none> and password file <none>
2026-08-06T18:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:31Z Disabled control of system clock
I20260806 18:39:31.760200 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45757
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:45757
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42119/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/testchainca.cert with env {}
W20260806 18:39:31.880183 20922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:31.880534 20922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:31.880581 20922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:31.884958 20922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:31.885053 20922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:31.885070 20922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:31.885087 20922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:31.885102 20922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 18:39:31.885119 20922 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 18:39:31.885182 20922 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42119/jwks.json
I20260806 18:39:31.891239 20922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:45757
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42119/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:31.892513 20922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:31.893684 20922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:31.903198 20933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:31.903208 20931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:31.903338 20922 server_base.cc:1034] running on GCE node
W20260806 18:39:31.903564 20937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:31.904227 20922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:31.905459 20922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:31.906642 20922 hybrid_clock.cc:648] HybridClock initialized: now 1786041571906626 us; error 30 us; skew 500 ppm
I20260806 18:39:31.908665 20922 webserver.cc:460] Webserver started at http://127.12.177.190:36779/ using document root <none> and password file <none>
I20260806 18:39:31.909269 20922 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:31.909392 20922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:31.909619 20922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:31.911891 20922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "715bc7485bc04c49be113bcde7d2cc61"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "9cf77b65a46e3cb832fdbc766c8f57db"
server_key_iv: "952bab4092c55bcf2d4f1c1637a38795"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.912505 20922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "715bc7485bc04c49be113bcde7d2cc61"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "9cf77b65a46e3cb832fdbc766c8f57db"
server_key_iv: "952bab4092c55bcf2d4f1c1637a38795"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.917064 20922 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:31.920327 20951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:31.922466 20922 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:39:31.922676 20922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "715bc7485bc04c49be113bcde7d2cc61"
format_stamp: "Formatted at 2026-08-06 18:39:31 on dist-test-slave-j2vl"
server_key: "9cf77b65a46e3cb832fdbc766c8f57db"
server_key_iv: "952bab4092c55bcf2d4f1c1637a38795"
server_key_version: "encryptionkey@0"
I20260806 18:39:31.922842 20922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:31.937981 20922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:31.938813 20922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:31.939049 20922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:31.947440 20922 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:45757
I20260806 18:39:31.947468 21025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:45757 every 8 connection(s)
I20260806 18:39:31.948566 20922 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:31.952102 21026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:31.958026 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 20922
I20260806 18:39:31.958184 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:31.958276 21026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61: Bootstrap starting.
I20260806 18:39:31.958552 12998 external_mini_cluster.cc:1428] Setting key b6dd514f8e44169218d7965c46a57df1
I20260806 18:39:31.961591 21026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:31.962564 21026 log.cc:824] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:31.965185 21026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61: No bootstrap required, opened a new log
I20260806 18:39:31.969017 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:31.960085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37916 (local address 127.12.177.190:45757)
0806 18:39:31.960786 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:31.960802 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:31.960843 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:39:31.961673 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:31.961695 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:31.962208 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:31.962527 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:31.962987 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.964015 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.965330 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:31.965897 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:31.966041 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:31.967013 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:31.967020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:31.967036 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:31.967478 (+ 442us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:31.967541 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:31.967563 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:31.967649 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:31.967831 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 18:39:31.968174 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":163,"threads_started":1}
I20260806 18:39:31.969696 21026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } }
I20260806 18:39:31.969959 21026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:31.970021 21026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 715bc7485bc04c49be113bcde7d2cc61, State: Initialized, Role: FOLLOWER
I20260806 18:39:31.970532 21026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } }
I20260806 18:39:31.970701 21026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:31.970799 21026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:31.970930 21026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:31.972214 21026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } }
I20260806 18:39:31.972343 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:39:31.972677 21026 leader_election.cc:302] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 715bc7485bc04c49be113bcde7d2cc61; no voters:
I20260806 18:39:31.973086 21026 leader_election.cc:288] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:31.973197 21035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:31.973464 21035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [term 1 LEADER]: Becoming Leader. State: Replica: 715bc7485bc04c49be113bcde7d2cc61, State: Running, Role: LEADER
I20260806 18:39:31.973850 21035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } }
I20260806 18:39:31.974685 21026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:31.975198 21037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 715bc7485bc04c49be113bcde7d2cc61. Latest consensus state: current_term: 1 leader_uuid: "715bc7485bc04c49be113bcde7d2cc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } } }
I20260806 18:39:31.975348 21037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:31.975689 21036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "715bc7485bc04c49be113bcde7d2cc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715bc7485bc04c49be113bcde7d2cc61" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45757 } } }
I20260806 18:39:31.975811 21036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:31.976086 21040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:31.979638 21040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:31.986228 21040 catalog_manager.cc:1347] Generated new cluster ID: d1c82c3d7a554c4791ea22ec4435f340
I20260806 18:39:31.986337 21040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:32.012559 21040 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:32.013728 21040 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:32.019951 21040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 715bc7485bc04c49be113bcde7d2cc61: Generated new TSK 0
I20260806 18:39:32.020951 21040 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 18:39:32.052023 21071 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 18:39:32.052129 21071 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 18:39:32.052855 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:32.036279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37926 (local address 127.12.177.190:45757)
0806 18:39:32.036437 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:32.036444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:32.036644 (+ 200us) server_negotiation.cc:407] Connection header received
0806 18:39:32.036830 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:32.036832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:32.036884 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:32.037012 (+ 128us) server_negotiation.cc:226] Negotiated authn=JWT
0806 18:39:32.037313 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.037975 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.039297 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.039535 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.039623 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.040019 (+ 396us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 18:39:32.052483 (+ 12464us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 18:39:32.052734 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37926: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 18:39:32.052950 21033 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37926: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 18:39:32.053134 21070 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:32.036175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45757 (local address 127.0.0.1:37926)
0806 18:39:32.036536 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:32.036553 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:32.036690 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:32.037026 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:32.037030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:32.037038 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 18:39:32.037161 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.037167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.038116 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.038119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.039154 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.039165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.039673 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.039677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.039783 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.039816 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 18:39:32.052715 (+ 12899us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 18:39:32.052944 (+ 229us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.177.190:45757: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":113,"threads_started":1}
I20260806 18:39:32.053944 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 20922
2026-08-06T18:39:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (358 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 18:39:32.105746 12998 mini_oidc.cc:152] Starting JWKS server
I20260806 18:39:32.106653 12998 webserver.cc:460] Webserver started at https://127.0.0.1:44661/ using document root <none> and password file <none>
I20260806 18:39:32.106745 12998 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 18:39:32.106958 12998 webserver.cc:460] Webserver started at http://127.0.0.1:38893/ using document root <none> and password file <none>
2026-08-06T18:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:32Z Disabled control of system clock
I20260806 18:39:32.118099 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46223
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:42581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:46223
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44661/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 18:39:32.239182 21081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:32.239519 21081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:32.239564 21081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:32.243912 21081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:32.244040 21081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:32.244060 21081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:32.244081 21081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:32.244122 21081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 18:39:32.244139 21081 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 18:39:32.244153 21081 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44661/jwks.json
I20260806 18:39:32.249442 21081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:46223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44661/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:32.250684 21081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:32.252152 21081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:32.261559 21090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:32.261497 21089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:32.261497 21094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:32.261961 21081 server_base.cc:1034] running on GCE node
I20260806 18:39:32.262651 21081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:32.264027 21081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:32.265254 21081 hybrid_clock.cc:648] HybridClock initialized: now 1786041572265228 us; error 43 us; skew 500 ppm
I20260806 18:39:32.267699 21081 webserver.cc:460] Webserver started at http://127.12.177.190:44415/ using document root <none> and password file <none>
I20260806 18:39:32.268394 21081 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:32.268503 21081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:32.268764 21081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:32.271123 21081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "3fadab6e74e648489c24637a35b6406f"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "70c3f74b0cbbab3ea087ac9b4def674a"
server_key_iv: "6cfe1b8d421e6c2ac3bb1c3cb753f0a5"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.271775 21081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "3fadab6e74e648489c24637a35b6406f"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "70c3f74b0cbbab3ea087ac9b4def674a"
server_key_iv: "6cfe1b8d421e6c2ac3bb1c3cb753f0a5"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.276157 21081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 18:39:32.279374 21101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:32.280882 21081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:32.281073 21081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "3fadab6e74e648489c24637a35b6406f"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "70c3f74b0cbbab3ea087ac9b4def674a"
server_key_iv: "6cfe1b8d421e6c2ac3bb1c3cb753f0a5"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.281230 21081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:32.295712 21081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:32.296545 21081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:32.296779 21081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:32.304612 21081 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:46223
I20260806 18:39:32.304623 21183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:46223 every 8 connection(s)
I20260806 18:39:32.305783 21081 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:32.309268 21184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:32.315356 21184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f: Bootstrap starting.
I20260806 18:39:32.315550 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21081
I20260806 18:39:32.315691 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:32.316015 12998 external_mini_cluster.cc:1428] Setting key 5ae9dd61269181148aad86b167c54d60
I20260806 18:39:32.318624 21184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:32.319490 21184 log.cc:824] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:32.321993 21184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f: No bootstrap required, opened a new log
I20260806 18:39:32.326740 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:32.317679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41954 (local address 127.12.177.190:46223)
0806 18:39:32.318454 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:32.318493 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:32.318537 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:39:32.319340 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:32.319361 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:32.319881 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:32.320328 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:32.320769 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.321886 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.323148 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.323665 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.323807 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.324719 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:32.324724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:32.324739 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:32.325167 (+ 428us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:32.325226 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:32.325247 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:32.325327 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:32.325587 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 18:39:32.325911 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":202,"threads_started":1}
I20260806 18:39:32.326606 21184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } }
I20260806 18:39:32.326920 21184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:32.326997 21184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fadab6e74e648489c24637a35b6406f, State: Initialized, Role: FOLLOWER
I20260806 18:39:32.327519 21184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } }
I20260806 18:39:32.327658 21184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:32.327747 21184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:32.328576 21184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:32.329905 21184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } }
I20260806 18:39:32.330018 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:39:32.330307 21184 leader_election.cc:302] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fadab6e74e648489c24637a35b6406f; no voters:
I20260806 18:39:32.330711 21184 leader_election.cc:288] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:32.330837 21191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:32.331291 21191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [term 1 LEADER]: Becoming Leader. State: Replica: 3fadab6e74e648489c24637a35b6406f, State: Running, Role: LEADER
I20260806 18:39:32.331616 21191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } }
I20260806 18:39:32.332094 21184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:32.332980 21191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fadab6e74e648489c24637a35b6406f. Latest consensus state: current_term: 1 leader_uuid: "3fadab6e74e648489c24637a35b6406f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } } }
I20260806 18:39:32.333117 21191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:32.333470 21192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fadab6e74e648489c24637a35b6406f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fadab6e74e648489c24637a35b6406f" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46223 } } }
I20260806 18:39:32.333564 21201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:32.333590 21192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:32.336717 21201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:32.342576 21201 catalog_manager.cc:1347] Generated new cluster ID: 0fb60f371a6049e197bddcb10d7f6aca
I20260806 18:39:32.342671 21201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:32.366093 21201 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:32.367261 21201 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:32.374096 21201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fadab6e74e648489c24637a35b6406f: Generated new TSK 0
I20260806 18:39:32.375075 21201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:39:32.391225 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:32.385608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.12.177.190:46223)
0806 18:39:32.385777 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:32.385782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:32.385944 (+ 162us) server_negotiation.cc:407] Connection header received
0806 18:39:32.386097 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:32.386100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:32.386166 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:32.386294 (+ 128us) server_negotiation.cc:226] Negotiated authn=JWT
0806 18:39:32.386550 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.387392 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.388321 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.388706 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.388814 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.389195 (+ 381us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 18:39:32.390823 (+ 1628us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 18:39:32.391074 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 18:39:32.391309 21188 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 18:39:32.392953 21223 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:32.385529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46223 (local address 127.0.0.1:41960)
0806 18:39:32.385840 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:32.385857 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:32.385976 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:32.386311 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:32.386316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:32.386332 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0806 18:39:32.386437 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.386442 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.387545 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.387548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.388197 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.388206 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.388875 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.388879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.388955 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.388988 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 18:39:32.391010 (+ 2022us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 18:39:32.392767 (+ 1757us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.177.190:46223: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":1531,"thread_start_us":116,"threads_started":1}
I20260806 18:39:32.393785 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21081
E20260806 18:39:32.413650 21225 webserver.cc:533] Webserver: sslize failed:
E20260806 18:39:32.413770 21225 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T18:39:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (347 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T18:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:32Z Disabled control of system clock
I20260806 18:39:32.463807 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35463
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35463
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/testchainca.cert with env {}
W20260806 18:39:32.588928 21235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:32.589239 21235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:32.589284 21235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:32.593611 21235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:32.593693 21235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:32.593708 21235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:32.593726 21235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:32.593742 21235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 18:39:32.593801 21235 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 18:39:32.593835 21235 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 18:39:32.599623 21235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:32.600916 21235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:32.602102 21235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:32.612099 21242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:32.612274 21243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:32.612197 21235 server_base.cc:1034] running on GCE node
W20260806 18:39:32.612116 21245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:32.613062 21235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:32.614415 21235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:32.615650 21235 hybrid_clock.cc:648] HybridClock initialized: now 1786041572615634 us; error 33 us; skew 500 ppm
I20260806 18:39:32.618146 21235 webserver.cc:460] Webserver started at http://127.12.177.190:36501/ using document root <none> and password file <none>
I20260806 18:39:32.618827 21235 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:32.618940 21235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:32.619196 21235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:32.621645 21235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "2012c5307d434b048fad3206bd104766"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "5f99804744c40cf9ca8dbc8a910fa998"
server_key_iv: "a392aad297ac45297688f0aae4d6d8c7"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.622310 21235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "2012c5307d434b048fad3206bd104766"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "5f99804744c40cf9ca8dbc8a910fa998"
server_key_iv: "a392aad297ac45297688f0aae4d6d8c7"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.626600 21235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:32.629534 21261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:32.631040 21235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:32.631243 21235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "2012c5307d434b048fad3206bd104766"
format_stamp: "Formatted at 2026-08-06 18:39:32 on dist-test-slave-j2vl"
server_key: "5f99804744c40cf9ca8dbc8a910fa998"
server_key_iv: "a392aad297ac45297688f0aae4d6d8c7"
server_key_version: "encryptionkey@0"
I20260806 18:39:32.631397 21235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:32.647086 21235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:32.647962 21235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:32.648211 21235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:32.656644 21235 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35463
I20260806 18:39:32.656693 21333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35463 every 8 connection(s)
I20260806 18:39:32.657800 21235 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:32.661053 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:32.662364 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21235
I20260806 18:39:32.662513 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:32.662850 12998 external_mini_cluster.cc:1428] Setting key 75b3aa6d6eee26d3e0a796a0bb2583b2
I20260806 18:39:32.668275 21335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766: Bootstrap starting.
I20260806 18:39:32.670871 21335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:32.671711 21335 log.cc:824] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:32.673141 21339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:32.664417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56386 (local address 127.12.177.190:35463)
0806 18:39:32.665209 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:32.665248 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:32.665292 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:39:32.666044 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:32.666064 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:32.666526 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:32.666914 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:32.667395 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.668376 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.669329 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.669886 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.670069 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.671003 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:32.671029 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:32.671049 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:39:32.671496 (+ 447us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:32.671559 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:39:32.671581 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:32.671700 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:32.671861 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 18:39:32.672147 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":163,"threads_started":1}
I20260806 18:39:32.674304 21335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766: No bootstrap required, opened a new log
I20260806 18:39:32.676371 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:39:32.678673 21335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } }
I20260806 18:39:32.678977 21335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:32.679060 21335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2012c5307d434b048fad3206bd104766, State: Initialized, Role: FOLLOWER
I20260806 18:39:32.679574 21335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } }
I20260806 18:39:32.679752 21335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:32.679849 21335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:32.679975 21335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:32.681074 21335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } }
I20260806 18:39:32.681537 21335 leader_election.cc:302] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2012c5307d434b048fad3206bd104766; no voters:
I20260806 18:39:32.681912 21335 leader_election.cc:288] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:32.682070 21341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:32.682344 21341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [term 1 LEADER]: Becoming Leader. State: Replica: 2012c5307d434b048fad3206bd104766, State: Running, Role: LEADER
I20260806 18:39:32.682700 21341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } }
I20260806 18:39:32.683491 21335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:32.684742 21342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2012c5307d434b048fad3206bd104766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } } }
I20260806 18:39:32.684929 21342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:32.685231 21343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2012c5307d434b048fad3206bd104766. Latest consensus state: current_term: 1 leader_uuid: "2012c5307d434b048fad3206bd104766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2012c5307d434b048fad3206bd104766" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35463 } } }
I20260806 18:39:32.685374 21343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:32.685595 21355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:32.688854 21355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:32.694929 21355 catalog_manager.cc:1347] Generated new cluster ID: ca64a947e6694cc69a06a3ad16261e25
I20260806 18:39:32.695037 21355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:32.705669 21355 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:32.707077 21355 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:32.726243 21355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2012c5307d434b048fad3206bd104766: Generated new TSK 0
I20260806 18:39:32.727121 21355 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:39:33.177776 21339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:32.739417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56394 (local address 127.12.177.190:35463)
0806 18:39:32.739574 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:32.739578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:32.739722 (+ 144us) server_negotiation.cc:407] Connection header received
0806 18:39:32.739948 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:32.739951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:32.740008 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:32.740118 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0806 18:39:32.740444 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.741020 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.742307 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.742546 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.742631 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.743005 (+ 374us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 18:39:33.177219 (+434214us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 18:39:33.177643 (+ 424us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56394: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 18:39:33.177897 21339 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56394: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 18:39:33.178036 21382 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:32.739233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35463 (local address 127.0.0.1:56394)
0806 18:39:32.739613 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:32.739629 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:32.739763 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:32.740148 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:32.740152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:32.740161 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 18:39:32.740295 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.740302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.741149 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.741153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.742180 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:32.742193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:32.742689 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:32.742693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:32.742786 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:32.742817 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 18:39:33.177588 (+434771us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 18:39:33.177794 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.177.190:35463: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":132,"threads_started":1}
I20260806 18:39:33.178836 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21235
2026-08-06T18:39:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (752 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (138 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (140 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:33 dist-test-slave-j2vl krb5kdc[21396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:33 dist-test-slave-j2vl krb5kdc[21396](info): set up 2 sockets
Aug 06 18:39:33 dist-test-slave-j2vl krb5kdc[21396](info): commencing operation
krb5kdc: starting...
W20260806 18:39:34.750991 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:34 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:34.898178 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35505
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:35.026546 21412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:35.026921 21412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:35.027009 21412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:35.031370 21412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:35.031497 21412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:35.031538 21412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:35.031577 21412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:35.031610 21412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:35.037519 21412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:35.039007 21412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:35.040207 21412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:35.050571 21412 server_base.cc:1034] running on GCE node
W20260806 18:39:35.050599 21423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.050599 21420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.050841 21417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.051581 21412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:35.052939 21412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:35.054172 21412 hybrid_clock.cc:648] HybridClock initialized: now 1786041575054136 us; error 53 us; skew 500 ppm
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:35.057809 21412 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:35.059067 21412 webserver.cc:460] Webserver started at http://127.12.177.190:44541/ using document root <none> and password file <none>
I20260806 18:39:35.059772 21412 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:35.059885 21412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:35.060148 21412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:35.062615 21412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "58b0bc1775ca48dc81d63a49dc6fa840"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8e824d1e2fa02602f2ba190ba181545b"
server_key_iv: "ac1386c631904b8a22f3dd5c62fa8643"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.063308 21412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "58b0bc1775ca48dc81d63a49dc6fa840"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8e824d1e2fa02602f2ba190ba181545b"
server_key_iv: "ac1386c631904b8a22f3dd5c62fa8643"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.068274 21412 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 18:39:35.071393 21436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.072851 21412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:35.073038 21412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "58b0bc1775ca48dc81d63a49dc6fa840"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8e824d1e2fa02602f2ba190ba181545b"
server_key_iv: "ac1386c631904b8a22f3dd5c62fa8643"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.073184 21412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:35.096531 21412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:35.100162 21412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:35.100394 21412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:35.108191 21412 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35505
I20260806 18:39:35.108248 21512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35505 every 8 connection(s)
I20260806 18:39:35.109305 21412 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:35.112344 21514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:35.118007 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21412
I20260806 18:39:35.118171 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:35.118381 21514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: Bootstrap starting.
I20260806 18:39:35.118458 12998 external_mini_cluster.cc:1428] Setting key a4a86734058a0c28d89033218bab7e71
I20260806 18:39:35.121073 21514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:35.122067 21514 log.cc:824] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:35.124634 21514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: No bootstrap required, opened a new log
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:35.129617 21514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } }
I20260806 18:39:35.129909 21514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:35.130009 21514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58b0bc1775ca48dc81d63a49dc6fa840, State: Initialized, Role: FOLLOWER
I20260806 18:39:35.130553 21514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } }
I20260806 18:39:35.130719 21514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:35.130815 21514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:35.130923 21514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:35.131958 21514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } }
I20260806 18:39:35.132378 21514 leader_election.cc:302] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58b0bc1775ca48dc81d63a49dc6fa840; no voters:
I20260806 18:39:35.132776 21514 leader_election.cc:288] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:35.132944 21525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:35.133179 21525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [term 1 LEADER]: Becoming Leader. State: Replica: 58b0bc1775ca48dc81d63a49dc6fa840, State: Running, Role: LEADER
I20260806 18:39:35.133581 21525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } }
I20260806 18:39:35.134291 21514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:35.134506 21519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.119813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43430 (local address 127.12.177.190:35505)
0806 18:39:35.120251 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:35.120273 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:35.120310 (+ 37us) server_negotiation.cc:407] Connection header received
0806 18:39:35.120969 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:35.120986 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:35.121454 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:35.121757 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:35.122786 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.123914 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.125115 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.125695 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.125831 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.128978 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:35.128985 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:35.129003 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:35.129038 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:35.131059 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.131547 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.131553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.131561 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.131698 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.132010 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.132014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.132016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.132607 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:35.132816 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:35.133170 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 18:39:35.133583 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":151,"threads_started":1}
I20260806 18:39:35.134896 21525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } } }
I20260806 18:39:35.135023 21525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:35.135237 21525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58b0bc1775ca48dc81d63a49dc6fa840. Latest consensus state: current_term: 1 leader_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58b0bc1775ca48dc81d63a49dc6fa840" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35505 } } }
I20260806 18:39:35.135339 21525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840 [sys.catalog]: This master's current role is: LEADER
W20260806 18:39:35.139683 21549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:39:35.139825 21549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:39:35.139911 21532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:35.140735 21532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:35.147473 21532 catalog_manager.cc:1347] Generated new cluster ID: 39a687d6880e457f999135a3ab70295b
I20260806 18:39:35.147579 21532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:35.172479 21532 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:35.173947 21532 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:35.181294 21532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58b0bc1775ca48dc81d63a49dc6fa840: Generated new TSK 0
I20260806 18:39:35.182439 21532 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:35.230751 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:35.363147 21555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:35.363473 21555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:35.363520 21555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:35.367954 21555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:35.368036 21555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:35.368096 21555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:35.373945 21555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:35.375164 21555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:35.376284 21555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:35.386932 21555 server_base.cc:1034] running on GCE node
W20260806 18:39:35.386971 21571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.386937 21568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.386947 21567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.387723 21555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:35.388465 21555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:35.389667 21555 hybrid_clock.cc:648] HybridClock initialized: now 1786041575389637 us; error 43 us; skew 500 ppm
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:35.392843 21555 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:35.393951 21555 webserver.cc:460] Webserver started at http://127.12.177.129:43375/ using document root <none> and password file <none>
I20260806 18:39:35.394541 21555 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:35.394609 21555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:35.394822 21555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:35.397111 21555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "05baf3046ca9450f8c93491035124a46"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8cb7ec3537bbd0fd092982c498962be6"
server_key_iv: "da34dbf83d20ad9c254e304f37f30f26"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.397785 21555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "05baf3046ca9450f8c93491035124a46"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8cb7ec3537bbd0fd092982c498962be6"
server_key_iv: "da34dbf83d20ad9c254e304f37f30f26"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.402895 21555 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:39:35.406596 21582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.408289 21555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:35.408435 21555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "05baf3046ca9450f8c93491035124a46"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "8cb7ec3537bbd0fd092982c498962be6"
server_key_iv: "da34dbf83d20ad9c254e304f37f30f26"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.408565 21555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:35.421856 21555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:35.426257 21555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:35.426466 21555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:35.427166 21555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:35.428193 21555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:35.428252 21555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.428300 21555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:35.428318 21555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.439056 21555 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37689
I20260806 18:39:35.439141 21747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37689 every 8 connection(s)
I20260806 18:39:35.440204 21555 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:35.450560 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21555
I20260806 18:39:35.450750 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:35.451071 12998 external_mini_cluster.cc:1428] Setting key a69dc61f1d91fad72303a8eeb2bc01cc
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:35.456916 21519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.442406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:33917 (local address 127.12.177.190:35505)
0806 18:39:35.442554 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:35.442558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:35.443524 (+ 966us) server_negotiation.cc:407] Connection header received
0806 18:39:35.445010 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:35.445013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:35.445077 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:35.445202 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:35.446580 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.447132 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.448373 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.448617 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.448742 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.452062 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:35.452066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:35.452069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:35.452105 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:35.453925 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.454700 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.454704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.454705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.454819 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.455326 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.455331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.455334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.455644 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:35.455770 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:35.456497 (+ 727us) server_negotiation.cc:299] Negotiation successful
0806 18:39:35.456685 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:39:35.458071 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.442714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35505 (local address 127.12.177.129:33917)
0806 18:39:35.443252 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:35.443305 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:35.444772 (+ 1467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:35.445461 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:35.445469 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:35.445884 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:35.446404 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.446419 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.447288 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.447292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.448230 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.448241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.448804 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.448808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.448990 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.449734 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:35.449753 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:35.451824 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:35.454074 (+ 2250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.454085 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.454110 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.454559 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.454935 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.454941 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.454946 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.455180 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.455797 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:35.455805 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:35.456169 (+ 364us) client_negotiation.cc:769] Sending connection context
0806 18:39:35.456382 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 18:39:35.456723 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":152,"threads_started":1}
I20260806 18:39:35.459661 21748 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35505
I20260806 18:39:35.459967 21748 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:35.460537 21748 heartbeater.cc:511] Master 127.12.177.190:35505 requested a full tablet report, sending...
I20260806 18:39:35.462401 21459 ts_manager.cc:194] Registered new tserver with Master: 05baf3046ca9450f8c93491035124a46 (127.12.177.129:37689)
I20260806 18:39:35.463661 21459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:33917
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:35.489586 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:35.618575 21753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:35.618916 21753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:35.618965 21753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:35.623219 21753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:35.623309 21753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:35.623373 21753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:35.630522 21753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:35.631969 21753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:35.633268 21753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:35.645309 21765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.645598 21753 server_base.cc:1034] running on GCE node
W20260806 18:39:35.645699 21763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.645294 21759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.646255 21753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:35.647086 21753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:35.648307 21753 hybrid_clock.cc:648] HybridClock initialized: now 1786041575648262 us; error 38 us; skew 500 ppm
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:35.651646 21753 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:35.652755 21753 webserver.cc:460] Webserver started at http://127.12.177.130:37731/ using document root <none> and password file <none>
I20260806 18:39:35.653391 21753 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:35.653477 21753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:35.653676 21753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:35.656116 21753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "e1e0b454e9a7467291424944b3b50166"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "7c6292390e8eb25d6424608c789aced1"
server_key_iv: "3346a7340d256a39282f2419850bdbd3"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.656738 21753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "e1e0b454e9a7467291424944b3b50166"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "7c6292390e8eb25d6424608c789aced1"
server_key_iv: "3346a7340d256a39282f2419850bdbd3"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.661197 21753 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:39:35.664048 21775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.665561 21753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:35.665712 21753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "e1e0b454e9a7467291424944b3b50166"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "7c6292390e8eb25d6424608c789aced1"
server_key_iv: "3346a7340d256a39282f2419850bdbd3"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.665848 21753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:35.681267 21753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:35.685217 21753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:35.685505 21753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:35.686650 21753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:35.687649 21753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:35.687731 21753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.687803 21753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:35.687834 21753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.698230 21753 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:41467
I20260806 18:39:35.698246 21932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:41467 every 8 connection(s)
I20260806 18:39:35.699257 21753 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:35.708640 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21753
I20260806 18:39:35.708775 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:35.709163 12998 external_mini_cluster.cc:1428] Setting key 5648b81324a498774e0e4aa652b0e4fb
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:35.716532 21519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.701563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:58461 (local address 127.12.177.190:35505)
0806 18:39:35.701722 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:35.701726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:35.702700 (+ 974us) server_negotiation.cc:407] Connection header received
0806 18:39:35.704137 (+ 1437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:35.704140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:35.704204 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:35.704319 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:35.705776 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.706328 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.707610 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.707865 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.707988 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.711712 (+ 3724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:35.711716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:35.711719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:35.711757 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:35.713530 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.714413 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.714417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.714418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.714534 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.715039 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.715042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.715043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.715275 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:35.715357 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:35.716100 (+ 743us) server_negotiation.cc:299] Negotiation successful
0806 18:39:35.716266 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:39:35.717386 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.701998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35505 (local address 127.12.177.130:58461)
0806 18:39:35.702522 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:35.702573 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:35.703877 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:35.704521 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:35.704529 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:35.704954 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:35.705600 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.705619 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.706491 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.706493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.707453 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.707464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.708076 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.708080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.708313 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.709165 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:35.709190 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:35.711513 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:35.713712 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.713724 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.713752 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.714248 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.714646 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.714651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.714656 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.714913 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.715398 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:35.715409 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:35.715795 (+ 386us) client_negotiation.cc:769] Sending connection context
0806 18:39:35.715974 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 18:39:35.716288 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":138,"threads_started":1}
I20260806 18:39:35.718869 21933 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35505
I20260806 18:39:35.719169 21933 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:35.719759 21933 heartbeater.cc:511] Master 127.12.177.190:35505 requested a full tablet report, sending...
I20260806 18:39:35.721211 21459 ts_manager.cc:194] Registered new tserver with Master: e1e0b454e9a7467291424944b3b50166 (127.12.177.130:41467)
I20260806 18:39:35.721920 21459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:58461
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:35.749972 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:35.880318 21940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:35.880661 21940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:35.880709 21940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:35.886312 21940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:35.886407 21940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:35.886503 21940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:35.893078 21940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:35.894541 21940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:35.895752 21940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:35.907618 21947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:35.907627 21948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.908242 21940 server_base.cc:1034] running on GCE node
W20260806 18:39:35.907836 21951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:35.909099 21940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:35.910092 21940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:35.911307 21940 hybrid_clock.cc:648] HybridClock initialized: now 1786041575911269 us; error 54 us; skew 500 ppm
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:35.914904 21940 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:35.916330 21940 webserver.cc:460] Webserver started at http://127.12.177.131:32877/ using document root <none> and password file <none>
I20260806 18:39:35.917127 21940 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:35.917294 21940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:35.917615 21940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:35.920782 21940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "aa6ab51bc8524d7eac4aa5bfeebb8aa4"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "5e638021b299cdd50b49197af65b2baa"
server_key_iv: "eb14c657565dd88ba3dfd507125d0bb1"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.921861 21940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "aa6ab51bc8524d7eac4aa5bfeebb8aa4"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "5e638021b299cdd50b49197af65b2baa"
server_key_iv: "eb14c657565dd88ba3dfd507125d0bb1"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.927644 21940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:39:35.930945 21960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.932818 21940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:35.933018 21940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "aa6ab51bc8524d7eac4aa5bfeebb8aa4"
format_stamp: "Formatted at 2026-08-06 18:39:35 on dist-test-slave-j2vl"
server_key: "5e638021b299cdd50b49197af65b2baa"
server_key_iv: "eb14c657565dd88ba3dfd507125d0bb1"
server_key_version: "encryptionkey@0"
I20260806 18:39:35.933171 21940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:35.954411 21940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:35.958259 21940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:35.958523 21940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:35.959357 21940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:35.960361 21940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:35.960445 21940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.960527 21940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:35.960568 21940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:35.970295 21940 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:39999
I20260806 18:39:35.970319 22133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:39999 every 8 connection(s)
I20260806 18:39:35.971345 21940 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:35.979965 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 21940
I20260806 18:39:35.980134 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:35.980603 12998 external_mini_cluster.cc:1428] Setting key 7449aa0b98b3e7ff21633350dc710180
Aug 06 18:39:35 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041575, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:35.986671 21519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.973434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:48347 (local address 127.12.177.190:35505)
0806 18:39:35.973600 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:35.973605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:35.974537 (+ 932us) server_negotiation.cc:407] Connection header received
0806 18:39:35.975872 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:35.975876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:35.975927 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:35.976010 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:35.977530 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.978125 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.979290 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.979509 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.979599 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.983012 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:35.983016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:35.983018 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:35.983052 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:35.984492 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.985065 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.985068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.985070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.985157 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:35.985564 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:35.985567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:35.985568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:35.985775 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:35.985859 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:35.986418 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 18:39:35.986541 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:39:35.987603 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:35.973903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35505 (local address 127.12.177.131:48347)
0806 18:39:35.974364 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:35.974414 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:35.975644 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:35.976209 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:35.976216 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:35.976682 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:35.977316 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.977332 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.978253 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.978255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.979158 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:35.979167 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:35.979692 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:35.979697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:35.979958 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:35.980696 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:35.980721 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:35.982820 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:35.984604 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.984609 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.984624 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.984937 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.985268 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:35.985274 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:35.985277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:35.985457 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:35.985892 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:35.985898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:35.986182 (+ 284us) client_negotiation.cc:769] Sending connection context
0806 18:39:35.986350 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 18:39:35.986641 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":119,"threads_started":1}
I20260806 18:39:35.988920 22134 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35505
I20260806 18:39:35.989164 22134 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:35.989748 22134 heartbeater.cc:511] Master 127.12.177.190:35505 requested a full tablet report, sending...
I20260806 18:39:35.990844 21459 ts_manager.cc:194] Registered new tserver with Master: aa6ab51bc8524d7eac4aa5bfeebb8aa4 (127.12.177.131:39999)
I20260806 18:39:35.991461 21459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:48347
I20260806 18:39:35.995147 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/test-admin.keytab.
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.015750 12998 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 18:39:36.018877 22145 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:36.017370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47280 (local address 127.12.177.129:37689)
0806 18:39:36.017744 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.017750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.017775 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:39:36.017827 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.017833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.018039 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.018167 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.018694 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47280: BlockingRecv error: recv got EOF from 127.0.0.1:47280 (error 108)
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":162,"threads_started":1}
W20260806 18:39:36.018962 12998 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc' of type FILE
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.020164 12998 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.021272 12998 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:36.032783 22145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:36.022467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47282 (local address 127.12.177.129:37689)
0806 18:39:36.022758 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.022763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.022922 (+ 159us) server_negotiation.cc:407] Connection header received
0806 18:39:36.023125 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.023128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.023177 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.023262 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.023928 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.024738 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.025683 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.026116 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.026236 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:36.028946 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:36.028960 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:36.028977 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:36.029008 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:36.030867 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.031334 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.031339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.031341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.031427 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.031659 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.031661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.031662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.031976 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:36.032156 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:36.032399 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 18:39:36.032591 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181}
W20260806 18:39:36.037499 22145 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:36.036164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47288 (local address 127.12.177.129:37689)
0806 18:39:36.036353 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.036357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.036372 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:36.036576 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.036578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.036622 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.036685 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.037329 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47288: BlockingRecv error: recv got EOF from 127.0.0.1:47288 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 18:39:36.037489 12998 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc' of type FILE
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.038810 12998 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.039813 12998 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:36.049495 22145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:36.040759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47298 (local address 127.12.177.129:37689)
0806 18:39:36.040911 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.040916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.041049 (+ 133us) server_negotiation.cc:407] Connection header received
0806 18:39:36.041209 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.041212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.041266 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.041391 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.042086 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.042627 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.043451 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.043691 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.043796 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:36.046265 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:36.046269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:36.046272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:36.046308 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:36.047732 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.048187 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.048191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.048193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.048283 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.048567 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.048571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.048573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.048773 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:36.048936 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:36.049169 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 18:39:36.049294 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 18:39:36.052330 22145 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:36.051421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47300 (local address 127.12.177.129:37689)
0806 18:39:36.051585 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.051588 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.051639 (+ 51us) server_negotiation.cc:407] Connection header received
0806 18:39:36.051735 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.051738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.051776 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.051841 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.052211 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47300: BlockingRecv error: recv got EOF from 127.0.0.1:47300 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260806 18:39:36.052686 12998 init.cc:244] Error while opening credential cache '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786041540454168-12998-0/krb5kdc/krb5cc)
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.053982 12998 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:36.055166 12998 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[21396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:39:36.064989 22145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:36.056309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47304 (local address 127.12.177.129:37689)
0806 18:39:36.056513 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:36.056518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:36.056603 (+ 85us) server_negotiation.cc:407] Connection header received
0806 18:39:36.056780 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:36.056783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:36.056840 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:36.056933 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:36.057524 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.058051 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.058870 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:36.059094 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:36.059205 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:36.061826 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:36.061829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:36.061831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:36.061869 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:36.063221 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.063718 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.063721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.063722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.063839 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:36.064130 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:36.064134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:36.064135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:36.064374 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:36.064518 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:36.064731 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 18:39:36.064862 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260806 18:39:36.066287 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21555
I20260806 18:39:36.081672 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21753
I20260806 18:39:36.106699 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21940
I20260806 18:39:36.129930 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 21412
2026-08-06T18:39:36Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2673 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[22170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[22170](info): set up 2 sockets
Aug 06 18:39:36 dist-test-slave-j2vl krb5kdc[22170](info): commencing operation
krb5kdc: starting...
W20260806 18:39:37.396410 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:37 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:37Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab.
Entry for principal oryx/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab.
I20260806 18:39:37.537016 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37033
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab
--principal=oryx/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:37.659988 22191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:37.660353 22191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:37.660400 22191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:37.664714 22191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:37.664796 22191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:37.664816 22191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:37.664836 22191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:37.664853 22191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:37.671203 22191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab
--principal=oryx/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:37.672477 22191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:37.673602 22191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:39:37.683606 22191 server_base.cc:1034] running on GCE node
W20260806 18:39:37.683557 22201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:37.683521 22197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:37.683537 22198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:37.684669 22191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:37.686014 22191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:37.687227 22191 hybrid_clock.cc:648] HybridClock initialized: now 1786041577687206 us; error 38 us; skew 500 ppm
Aug 06 18:39:37 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:37.690639 22191 init.cc:377] Logged in from keytab as oryx/127.12.177.190@KRBTEST.COM (short username oryx)
I20260806 18:39:37.691659 22191 webserver.cc:460] Webserver started at http://127.12.177.190:36429/ using document root <none> and password file <none>
I20260806 18:39:37.692262 22191 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:37.692325 22191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:37.692553 22191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:37.694823 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "0908f1618b25418bbdc39aa2ec9f166c"
format_stamp: "Formatted at 2026-08-06 18:39:37 on dist-test-slave-j2vl"
server_key: "09c1a1bd8d8a60d51afffdbbf622f87b"
server_key_iv: "959d51b4cc8706a2a07cac6411e09746"
server_key_version: "encryptionkey@0"
I20260806 18:39:37.695446 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "0908f1618b25418bbdc39aa2ec9f166c"
format_stamp: "Formatted at 2026-08-06 18:39:37 on dist-test-slave-j2vl"
server_key: "09c1a1bd8d8a60d51afffdbbf622f87b"
server_key_iv: "959d51b4cc8706a2a07cac6411e09746"
server_key_version: "encryptionkey@0"
I20260806 18:39:37.699566 22191 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:37.702252 22215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:37.703552 22191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:37.703683 22191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "0908f1618b25418bbdc39aa2ec9f166c"
format_stamp: "Formatted at 2026-08-06 18:39:37 on dist-test-slave-j2vl"
server_key: "09c1a1bd8d8a60d51afffdbbf622f87b"
server_key_iv: "959d51b4cc8706a2a07cac6411e09746"
server_key_version: "encryptionkey@0"
I20260806 18:39:37.703795 22191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:37.747462 22191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:37.750723 22191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:37.750949 22191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:37.758502 22191 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:37033
I20260806 18:39:37.758880 22290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:37033 every 8 connection(s)
I20260806 18:39:37.759627 22191 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:37.762631 22291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:37.766036 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 22191
I20260806 18:39:37.766184 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:37.766517 12998 external_mini_cluster.cc:1428] Setting key 23eb8b97a7a04aff30d5d791dc08d251
I20260806 18:39:37.769163 22291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Bootstrap starting.
I20260806 18:39:37.772132 22291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:37.773059 22291 log.cc:824] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:37.775478 22291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: No bootstrap required, opened a new log
Aug 06 18:39:37 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:37.780421 22291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } }
I20260806 18:39:37.780750 22291 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:37.780810 22291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0908f1618b25418bbdc39aa2ec9f166c, State: Initialized, Role: FOLLOWER
I20260806 18:39:37.781397 22291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } }
I20260806 18:39:37.781569 22291 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:37.781668 22291 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:37.781772 22291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:37.782922 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:37.768043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50986 (local address 127.12.177.190:37033)
0806 18:39:37.768534 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:37.768554 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:37.768598 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:39:37.769513 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:37.769538 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:37.769985 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:37.770369 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:37.771076 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:37.772581 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:37.773720 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:37.774403 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:37.774578 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:37.777290 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:37.777296 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:37.777317 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:37.777373 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:37.779498 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:37.779951 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:37.779957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:37.779963 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:37.780111 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:37.780373 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:37.780376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:37.780378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:37.780973 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:37.781183 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:37.781525 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 18:39:37.781875 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":149,"threads_started":1}
I20260806 18:39:37.783038 22291 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } }
I20260806 18:39:37.783397 22291 leader_election.cc:302] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0908f1618b25418bbdc39aa2ec9f166c; no voters:
I20260806 18:39:37.783746 22291 leader_election.cc:288] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:37.783874 22299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:37.784121 22299 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 LEADER]: Becoming Leader. State: Replica: 0908f1618b25418bbdc39aa2ec9f166c, State: Running, Role: LEADER
I20260806 18:39:37.784523 22299 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } }
I20260806 18:39:37.785065 22291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:37.786072 22301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0908f1618b25418bbdc39aa2ec9f166c. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } }
I20260806 18:39:37.786255 22301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:37.786358 22303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } }
I20260806 18:39:37.786469 22303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:37.786867 22310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:37.790781 22310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:37.797434 22310 catalog_manager.cc:1347] Generated new cluster ID: d4305653a1164035baaf011fd1089b2c
I20260806 18:39:37.797540 22310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:37.811780 22310 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:37.813184 22310 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:37.821403 22310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Generated new TSK 0
I20260806 18:39:37.822417 22310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
I20260806 18:39:37.857823 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:37.987735 22330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:37.988046 22330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:37.988093 22330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:37.992239 22330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:37.992324 22330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:37.992389 22330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:37.998356 22330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:37.999557 22330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:38.000851 22330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:38.012096 22344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.012085 22337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.012079 22339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:38.012358 22330 server_base.cc:1034] running on GCE node
I20260806 18:39:38.012827 22330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:38.013579 22330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:38.014757 22330 hybrid_clock.cc:648] HybridClock initialized: now 1786041578014738 us; error 35 us; skew 500 ppm
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:38.017863 22330 init.cc:377] Logged in from keytab as oryx/127.12.177.129@KRBTEST.COM (short username oryx)
I20260806 18:39:38.018857 22330 webserver.cc:460] Webserver started at http://127.12.177.129:44421/ using document root <none> and password file <none>
I20260806 18:39:38.019465 22330 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:38.019532 22330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:38.019757 22330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:38.022089 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "9c4202e0f95149ad8e3e7bee46d4222a"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "8c420af8c9605c1d7c3e14ab2b873537"
server_key_iv: "c90f88961a19c91c286d7371792e0022"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.022728 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "9c4202e0f95149ad8e3e7bee46d4222a"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "8c420af8c9605c1d7c3e14ab2b873537"
server_key_iv: "c90f88961a19c91c286d7371792e0022"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.026932 22330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:38.029743 22359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.031258 22330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:39:38.031500 22330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "9c4202e0f95149ad8e3e7bee46d4222a"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "8c420af8c9605c1d7c3e14ab2b873537"
server_key_iv: "c90f88961a19c91c286d7371792e0022"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.031636 22330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:38.051865 22330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:38.055713 22330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:38.055964 22330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:38.056677 22330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:38.057665 22330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:38.057717 22330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.057788 22330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:38.057821 22330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.068297 22330 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:34013
I20260806 18:39:38.068344 22527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:34013 every 8 connection(s)
I20260806 18:39:38.069322 22330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:38.077186 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 22330
I20260806 18:39:38.077338 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:38.077688 12998 external_mini_cluster.cc:1428] Setting key a66820d2e34a763756143e8101ad1f1d
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:38.084738 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.071742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42887 (local address 127.12.177.190:37033)
0806 18:39:38.071930 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.071935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.072845 (+ 910us) server_negotiation.cc:407] Connection header received
0806 18:39:38.074304 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.074307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.074362 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.074447 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.075724 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.076300 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.077724 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.078070 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.078230 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.080994 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.080997 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.080999 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.081025 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.082609 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.083159 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.083163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.083165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.083253 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.083602 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.083605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.083607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.083808 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.083914 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.084433 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.084566 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 18:39:38.085738 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.072129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:42887)
0806 18:39:38.072662 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.072710 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.074057 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.074621 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.074627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.075057 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.075566 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.075580 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.076427 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.076429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.077586 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.077597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.078278 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.078282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.078471 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.079154 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.079172 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.080763 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.082739 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.082745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.082763 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.083049 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.083346 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.083349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.083352 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.083505 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.083914 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.083922 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.084190 (+ 268us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.084389 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.084734 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":132,"threads_started":1}
I20260806 18:39:38.087050 22528 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:38.087311 22528 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:38.087860 22528 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:38.089486 22237 ts_manager.cc:194] Registered new tserver with Master: 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:38.090747 22237 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:42887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
I20260806 18:39:38.113088 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:38.243396 22534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:38.243741 22534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:38.243788 22534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:38.248198 22534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:38.248301 22534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:38.248364 22534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:38.255395 22534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:38.256757 22534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:38.258028 22534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:38.270079 22546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.270080 22550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.270079 22548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:38.270536 22534 server_base.cc:1034] running on GCE node
I20260806 18:39:38.271059 22534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:38.271839 22534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:38.273079 22534 hybrid_clock.cc:648] HybridClock initialized: now 1786041578273038 us; error 54 us; skew 500 ppm
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:38.276530 22534 init.cc:377] Logged in from keytab as oryx/127.12.177.130@KRBTEST.COM (short username oryx)
I20260806 18:39:38.277839 22534 webserver.cc:460] Webserver started at http://127.12.177.130:44989/ using document root <none> and password file <none>
I20260806 18:39:38.278537 22534 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:38.278638 22534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:38.278909 22534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:38.281248 22534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "2669b5432742417e8c4c861991e436ad"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "412b90ffcb1c69437d567660c802dcc6"
server_key_iv: "22c1d49d13a0ea71bd9ebe6fe51423b1"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.281980 22534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "2669b5432742417e8c4c861991e436ad"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "412b90ffcb1c69437d567660c802dcc6"
server_key_iv: "22c1d49d13a0ea71bd9ebe6fe51423b1"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.286561 22534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:38.289637 22559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.291082 22534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:39:38.291252 22534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "2669b5432742417e8c4c861991e436ad"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "412b90ffcb1c69437d567660c802dcc6"
server_key_iv: "22c1d49d13a0ea71bd9ebe6fe51423b1"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.291396 22534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:38.304738 22534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:38.308321 22534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:38.308549 22534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:38.309224 22534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:38.310254 22534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:38.310324 22534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.310397 22534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:38.310438 22534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.319583 22534 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:45843
I20260806 18:39:38.319610 22735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:45843 every 8 connection(s)
I20260806 18:39:38.320499 22534 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:38.322245 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 22534
I20260806 18:39:38.322384 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:38.322701 12998 external_mini_cluster.cc:1428] Setting key 6b01bad5e1364369577c5c4ae228f6ec
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:38.339053 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.322509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:47323 (local address 127.12.177.190:37033)
0806 18:39:38.322662 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.322667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.323730 (+ 1063us) server_negotiation.cc:407] Connection header received
0806 18:39:38.325759 (+ 2029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.325762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.325811 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.325887 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.327431 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.328263 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.330274 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.330529 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.330625 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.334388 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.334393 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.334396 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.334430 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.336262 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.337038 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.337042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.337043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.337132 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.337637 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.337640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.337641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.337866 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.337993 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.338677 (+ 684us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.338840 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:38.340044 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.322988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:47323)
0806 18:39:38.323580 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.323627 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.325495 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.326122 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.326134 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.326692 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.327265 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.327280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.328413 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.328417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.330126 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.330146 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.330723 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.330730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.331014 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.331758 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.331788 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.334100 (+ 2312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.336432 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.336462 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.336487 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.336895 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.337236 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.337239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.337241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.337487 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.337994 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.338004 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.338373 (+ 369us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.338614 (+ 241us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.339039 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":142,"threads_started":1}
I20260806 18:39:38.341701 22736 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:38.342029 22736 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:38.342664 22736 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
I20260806 18:39:38.344127 22237 ts_manager.cc:194] Registered new tserver with Master: 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:38.344877 22237 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:47323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
I20260806 18:39:38.362689 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:38.490157 22742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:38.490504 22742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:38.490586 22742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:38.495061 22742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:38.495162 22742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:38.495252 22742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:38.501327 22742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:37033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:38.502637 22742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:38.503774 22742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:38.514026 22752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.514068 22755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.514102 22751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:38.514582 22742 server_base.cc:1034] running on GCE node
I20260806 18:39:38.515098 22742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:38.515789 22742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:38.519114 22742 hybrid_clock.cc:648] HybridClock initialized: now 1786041578519064 us; error 53 us; skew 500 ppm
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:38.522495 22742 init.cc:377] Logged in from keytab as oryx/127.12.177.131@KRBTEST.COM (short username oryx)
I20260806 18:39:38.523595 22742 webserver.cc:460] Webserver started at http://127.12.177.131:36231/ using document root <none> and password file <none>
I20260806 18:39:38.524253 22742 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:38.524355 22742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:38.524610 22742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:38.527011 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "6b901e7a181549be9c16649bc9ace4fc"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "a0e8d818d128f3a1a77f5675a9418f36"
server_key_iv: "57c7bc1b0464c6549551ff848abdbf1f"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.527673 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "6b901e7a181549be9c16649bc9ace4fc"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "a0e8d818d128f3a1a77f5675a9418f36"
server_key_iv: "57c7bc1b0464c6549551ff848abdbf1f"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.532055 22742 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:39:38.535110 22767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.536720 22742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:38.536909 22742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "6b901e7a181549be9c16649bc9ace4fc"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "a0e8d818d128f3a1a77f5675a9418f36"
server_key_iv: "57c7bc1b0464c6549551ff848abdbf1f"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.537047 22742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:38.563920 22742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:38.567718 22742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:38.568025 22742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:38.568720 22742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:38.569710 22742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:38.569770 22742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.569841 22742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:38.569878 22742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.579815 22742 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:35869
I20260806 18:39:38.579840 22939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:35869 every 8 connection(s)
I20260806 18:39:38.580772 22742 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:38.582055 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 22742
I20260806 18:39:38.582187 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:38.582520 12998 external_mini_cluster.cc:1428] Setting key 8ac2f232fb02d98b8d557c5f836ba51c
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:38.596097 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.583328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:47787 (local address 127.12.177.190:37033)
0806 18:39:38.583494 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.583499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.584303 (+ 804us) server_negotiation.cc:407] Connection header received
0806 18:39:38.585940 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.585943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.585992 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.586062 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.587355 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.587922 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.589135 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.589401 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.589495 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.592039 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.592042 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.592044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.592069 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.593639 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.594228 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.594232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.594234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.594324 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.594692 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.594696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.594698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.594979 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.595090 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.595730 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.595897 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 18:39:38.597059 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.583569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:47787)
0806 18:39:38.584121 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.584178 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.585642 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.586227 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.586234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.586620 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.587203 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.587217 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.588084 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.588087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.588999 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.589010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.589561 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.589564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.589716 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.590317 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.590335 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.591850 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.593773 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.593801 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.593821 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.594118 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.594430 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.594433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.594435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.594594 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.595127 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.595133 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.595470 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.595665 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.596054 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":163,"threads_started":1}
I20260806 18:39:38.598362 22940 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:38.598628 22940 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:38.599215 22940 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
I20260806 18:39:38.600513 22237 ts_manager.cc:194] Registered new tserver with Master: 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869)
I20260806 18:39:38.601110 22237 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:47787
I20260806 18:39:38.609002 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.177.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.189.keytab.
Entry for principal oryx/127.12.177.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.189.keytab.
I20260806 18:39:38.641014 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:37489
--webserver_interface=127.12.177.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.189.keytab
--principal=oryx/127.12.177.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37033,127.12.177.189:37489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:38.765146 22946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:38.765488 22946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:38.765576 22946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:38.769873 22946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:38.769953 22946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:38.769973 22946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:38.769992 22946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:38.770008 22946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:38.775725 22946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37033,127.12.177.189:37489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.189.keytab
--principal=oryx/127.12.177.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:37489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.177.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
W20260806 18:39:38.776057 22946 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.177.190:37033,127.12.177.189:37489'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 18:39:38.777099 22946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:38.778251 22946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:38.788281 22958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:38.788275 22952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:38.788470 22946 server_base.cc:1034] running on GCE node
W20260806 18:39:38.788552 22956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:38.789681 22946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:38.790944 22946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:38.792155 22946 hybrid_clock.cc:648] HybridClock initialized: now 1786041578792130 us; error 35 us; skew 500 ppm
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:38.795980 22946 init.cc:377] Logged in from keytab as oryx/127.12.177.189@KRBTEST.COM (short username oryx)
I20260806 18:39:38.797132 22946 webserver.cc:460] Webserver started at http://127.12.177.189:45209/ using document root <none> and password file <none>
I20260806 18:39:38.797843 22946 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:38.797941 22946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:38.798267 22946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:38.800531 22946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/instance:
uuid: "7be86214a241446a953a80c67fafbb7d"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "c4482dba0a56854024f76b514045577d"
server_key_iv: "912b6cc65c06f9625e3cc4fc34168cea"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.801165 22946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal/instance:
uuid: "7be86214a241446a953a80c67fafbb7d"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "c4482dba0a56854024f76b514045577d"
server_key_iv: "912b6cc65c06f9625e3cc4fc34168cea"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.805317 22946 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 18:39:38.808346 22971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.810127 22946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 18:39:38.810396 22946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "7be86214a241446a953a80c67fafbb7d"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "c4482dba0a56854024f76b514045577d"
server_key_iv: "912b6cc65c06f9625e3cc4fc34168cea"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.810576 22946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:38.854580 22946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:38.857846 22946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:38.858054 22946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:38.865962 22946 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.189:37489
I20260806 18:39:38.866318 23044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.189:37489 every 8 connection(s)
I20260806 18:39:38.867161 22946 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
I20260806 18:39:38.870070 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 22946
I20260806 18:39:38.870855 23045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:38.875926 23045 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.189@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:38.886071 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.871808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46186 (local address 127.12.177.189:37489)
0806 18:39:38.872255 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.872279 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.872317 (+ 38us) server_negotiation.cc:407] Connection header received
0806 18:39:38.872989 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.873007 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.873390 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.873697 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.874688 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.875778 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.876933 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.877480 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.877653 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.880817 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.880823 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.880835 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.880868 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.882763 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.883252 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.883257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.883261 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.883373 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.883704 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.883708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.883710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.884193 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.884402 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.884746 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.885053 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":162,"threads_started":1}
I20260806 18:39:38.888239 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.878030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.12.177.190:37033)
0806 18:39:38.878187 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.878194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.878628 (+ 434us) server_negotiation.cc:407] Connection header received
0806 18:39:38.878801 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.878806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.878868 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.878974 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.879847 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.880532 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.881580 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.881948 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.882072 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.884535 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.884538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.884541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.884574 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.886153 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.886736 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.886739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.886741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.886824 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.887126 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.887130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.887132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.887375 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.887589 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.887921 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.888063 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:38.888262 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.877970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:50992)
0806 18:39:38.878475 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.878531 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.878671 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.879045 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.879055 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.879562 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.879711 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.879717 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.880687 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.880694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.881454 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.881464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.882089 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.882092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.882182 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.882805 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.882840 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.884363 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.886304 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.886313 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.886320 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.886569 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.886940 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.886944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.886946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.887030 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.887584 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.887590 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.887715 (+ 125us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.887864 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.888067 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"spinlock_wait_cycles":56064,"thread_start_us":126,"threads_started":1}
I20260806 18:39:38.889824 23045 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041578, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.189@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
I20260806 18:39:38.898882 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.890410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46200)
0806 18:39:38.890577 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.890598 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.890672 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.890879 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.890881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.891037 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.891135 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.891140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.892273 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.892276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.892829 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.892838 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.893421 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.893425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.893509 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.894055 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.894068 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.895433 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.897270 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.897273 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.897274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.897546 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.897832 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.897835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.897836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.897961 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.898399 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.898402 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.898496 (+ 94us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.898602 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.898747 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 18:39:38.898990 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.890520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.12.177.189:37489)
0806 18:39:38.890662 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.890666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.890681 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:38.890728 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.890730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.890765 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.890840 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.891234 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.892136 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.892941 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.893213 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.893298 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.895583 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.895587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.895589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.895612 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.897152 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.897644 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.897646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.897647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.897724 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.898071 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.898074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.898075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.898288 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.898377 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.898655 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.898809 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":68}
I20260806 18:39:38.902199 23045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Bootstrap starting.
I20260806 18:39:38.904656 23045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:38.905480 23045 log.cc:824] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:38.907709 23045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: No bootstrap required, opened a new log
I20260806 18:39:38.910993 23045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } }
I20260806 18:39:38.911214 23045 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:38.911249 23045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be86214a241446a953a80c67fafbb7d, State: Initialized, Role: FOLLOWER
I20260806 18:39:38.911696 23045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } }
I20260806 18:39:38.912221 23055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } } }
I20260806 18:39:38.912375 23055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:38.913015 23045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: configured and running, proceeding with master startup.
W20260806 18:39:38.918529 23077 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:39:38.918654 23077 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:39:38.921180 22946 master_runner.cc:428] Detected that this master 7be86214a241446a953a80c67fafbb7d is joining an existing cluster
I20260806 18:39:38.921280 22946 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.177.189:37489
I20260806 18:39:38.932819 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.924073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46208 (local address 127.12.177.189:37489)
0806 18:39:38.924228 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.924232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.924581 (+ 349us) server_negotiation.cc:407] Connection header received
0806 18:39:38.924737 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.924743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.924788 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.924883 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.925397 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.925981 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927210 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.927466 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927575 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.929212 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.929215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.929218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.929241 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.930963 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931535 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.931540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.931543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.931624 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931938 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.931941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.931943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.932136 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.932246 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.932483 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.932687 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":51}
I20260806 18:39:38.932834 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.924002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46208)
0806 18:39:38.924499 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.924516 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.924634 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.924895 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.924898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.925131 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.925245 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.925251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.926117 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.926121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.927080 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.927091 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.927594 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.927703 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.928699 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.928711 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.929076 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.931093 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931097 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.931099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.931434 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.931735 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931737 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.931739 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.931829 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.932233 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.932236 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.932322 (+ 86us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.932436 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.932608 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":132,"threads_started":1}
I20260806 18:39:38.933127 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.924147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51006 (local address 127.12.177.190:37033)
0806 18:39:38.924274 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.924284 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.924734 (+ 450us) server_negotiation.cc:407] Connection header received
0806 18:39:38.924933 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.924938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.924995 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.925058 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.925803 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.926440 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927323 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.927682 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927789 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.929159 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.929163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.929166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.929198 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.931090 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931699 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.931704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.931706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.931806 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.932132 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.932135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.932137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.932375 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.932449 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.932833 (+ 384us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.932966 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 18:39:38.933699 23086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.924001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51006)
0806 18:39:38.924629 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.924644 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.924815 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.925227 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.925230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.925526 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.925652 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.925660 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.926554 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.926560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.927127 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.927135 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.927921 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.927925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.928025 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.928456 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.928473 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.928987 (+ 514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.931220 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931224 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.931226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.931586 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.931908 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.931911 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.931913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.932011 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.932532 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.932535 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.932640 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.933368 (+ 728us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.933520 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":259,"thread_start_us":111,"threads_started":1}
Aug 06 18:39:38 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.190@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
I20260806 18:39:38.949831 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.938195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46216)
0806 18:39:38.938561 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.938617 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.938762 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.939115 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.939121 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.939647 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.939814 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.939831 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.940623 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.940628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.941533 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.941544 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.942076 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.942080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.942215 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.942872 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.942889 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.944994 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.947484 (+ 2490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.947500 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.947509 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.947885 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.948257 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.948260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.948269 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.948374 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.948981 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.948990 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.949155 (+ 165us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.949334 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.949634 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":97,"threads_started":1}
I20260806 18:39:38.949829 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.938242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46216 (local address 127.12.177.189:37489)
0806 18:39:38.938372 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.938377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.938700 (+ 323us) server_negotiation.cc:407] Connection header received
0806 18:39:38.938931 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.938934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.938987 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.939075 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.939945 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.940513 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.941658 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.941953 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.942057 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.945196 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.945203 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.945210 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.945250 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.947309 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.948016 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.948023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.948029 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.948140 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.948478 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.948483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.948485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.948849 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.948968 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.949476 (+ 508us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.949620 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for oryx/127.12.177.188@KRBTEST.COM; defaulting to no policy
I20260806 18:39:38.952318 22237 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.177.189:37489: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7be86214a241446a953a80c67fafbb7d"
member_type: NON_VOTER
last_known_addr {
host: "127.12.177.189"
port: 37489
}
attrs {
promote: true
}
}
dest_uuid: "0908f1618b25418bbdc39aa2ec9f166c"
cas_config_opid_index: -1
I20260806 18:39:38.953336 22237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.188@KRBTEST.COM" created.
I20260806 18:39:38.955731 23097 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7be86214a241446a953a80c67fafbb7d (127.12.177.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } }
I20260806 18:39:38.956544 23006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:38.957660 23097 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.177.189:37489
I20260806 18:39:38.957949 23097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } }
I20260806 18:39:38.958053 23097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:38.958174 23006 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 18:39:38.958232 22946 master.cc:537] Master@127.12.177.189:37489 shutting down...
I20260806 18:39:38.959300 23099 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 18:39:38.961445 22220 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 18:39:38.962723 22220 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c -> Peer 7be86214a241446a953a80c67fafbb7d (127.12.177.189:37489): Couldn't send request to peer 7be86214a241446a953a80c67fafbb7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 18:39:38.963696 22946 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:38.964022 22946 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:38.964152 22946 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: stopping tablet replica
I20260806 18:39:38.968711 22946 master.cc:552] Master@127.12.177.189:37489 shutdown complete.
I20260806 18:39:38.968788 22946 master_runner.cc:305] Clearing existing system tablet
I20260806 18:39:38.969022 22946 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:38.969099 22946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:38.970324 22946 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:38.971168 23104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:38.971362 22946 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:38.971508 22946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:38.971550 22946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "7be86214a241446a953a80c67fafbb7d"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "c4482dba0a56854024f76b514045577d"
server_key_iv: "912b6cc65c06f9625e3cc4fc34168cea"
server_key_version: "encryptionkey@0"
I20260806 18:39:38.974381 22946 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:38.976604 22946 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 18:39:38.976686 22946 log.cc:1196] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 18:39:38.976953 22946 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Deleting consensus metadata
I20260806 18:39:38.977124 22946 master_runner.cc:315] Copying system tablet from 127.12.177.190:37033
I20260806 18:39:38.978790 22946 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.177.190:37033
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.188.keytab.
Entry for principal oryx/127.12.177.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.188.keytab.
I20260806 18:39:38.982410 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:44643
--webserver_interface=127.12.177.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.188.keytab
--principal=oryx/127.12.177.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:39:38.988747 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.979783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.12.177.190:37033)
0806 18:39:38.979926 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:38.979931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:38.979952 (+ 21us) server_negotiation.cc:407] Connection header received
0806 18:39:38.980075 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:38.980079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:38.980131 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:38.980225 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:38.980813 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.981681 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.982871 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.983226 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.983341 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.985000 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:38.985006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:38.985010 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:38.985050 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:38.986924 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.987435 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.987439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.987441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.987530 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:38.987832 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:38.987835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:38.987837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:38.988047 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:38.988162 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:38.988438 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 18:39:38.988562 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 18:39:38.988763 23113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:38.979552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51016)
0806 18:39:38.979841 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:38.979859 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:38.979989 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:38.980289 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:38.980293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:38.980546 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:38.980648 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.980654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.981800 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.981805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.982734 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:38.982749 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:38.983490 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:38.983494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:38.983587 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:38.984302 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:38.984320 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:38.984811 (+ 491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:38.987068 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.987072 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.987074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.987325 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.987630 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:38.987633 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:38.987635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:38.987726 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:38.988150 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:38.988154 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:38.988266 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 18:39:38.988379 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 18:39:38.988558 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":101,"threads_started":1}
I20260806 18:39:38.990077 22270 tablet_copy_service.cc:140] P 0908f1618b25418bbdc39aa2ec9f166c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7be86214a241446a953a80c67fafbb7d ({username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:51016)
I20260806 18:39:38.990334 22270 tablet_copy_service.cc:161] P 0908f1618b25418bbdc39aa2ec9f166c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7be86214a241446a953a80c67fafbb7d at {username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:51016: session id = 7be86214a241446a953a80c67fafbb7d-00000000000000000000000000000000
I20260806 18:39:38.993013 22270 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 18:39:38.995805 22946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 18:39:38.998639 22946 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: tablet copy: Starting download of 0 data blocks...
I20260806 18:39:38.998868 22946 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: tablet copy: Starting download of 1 WAL segments...
I20260806 18:39:39.001147 22946 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 18:39:39.003126 22270 tablet_copy_service.cc:342] P 0908f1618b25418bbdc39aa2ec9f166c: Request end of tablet copy session 7be86214a241446a953a80c67fafbb7d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:51016
I20260806 18:39:39.003271 22270 tablet_copy_service.cc:433] P 0908f1618b25418bbdc39aa2ec9f166c: ending tablet copy session 7be86214a241446a953a80c67fafbb7d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7be86214a241446a953a80c67fafbb7d
I20260806 18:39:39.011716 22946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:39.013609 23118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.013625 23116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.014376 22946 server_base.cc:1034] running on GCE node
W20260806 18:39:39.017520 23121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.017807 22946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:39.018158 22946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:39.019315 22946 hybrid_clock.cc:648] HybridClock initialized: now 1786041579019291 us; error 43 us; skew 500 ppm
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:39.021049 22946 init.cc:377] Logged in from keytab as oryx/127.12.177.189@KRBTEST.COM (short username oryx)
I20260806 18:39:39.021633 22946 webserver.cc:460] Webserver started at http://127.12.177.189:41615/ using document root <none> and password file <none>
I20260806 18:39:39.021848 22946 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.021895 22946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.023339 22946 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:39.024536 23138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.024848 22946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:39.024935 22946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "7be86214a241446a953a80c67fafbb7d"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "c4482dba0a56854024f76b514045577d"
server_key_iv: "912b6cc65c06f9625e3cc4fc34168cea"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.025024 22946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.038676 22946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:39.041074 22946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:39.046801 22946 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.189:37489
I20260806 18:39:39.046831 23225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.189:37489 every 8 connection(s)
I20260806 18:39:39.047466 22946 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
I20260806 18:39:39.049491 23228 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:39:39.050741 23228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Bootstrap starting.
I20260806 18:39:39.062321 23228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:39:39.062736 23228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Bootstrap complete.
I20260806 18:39:39.063433 23228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } }
I20260806 18:39:39.063594 23228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7be86214a241446a953a80c67fafbb7d, State: Initialized, Role: LEARNER
I20260806 18:39:39.063719 23228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } }
I20260806 18:39:39.064139 23233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } }
I20260806 18:39:39.064260 23228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:39.064345 23233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: LEARNER
I20260806 18:39:39.067744 23249 catalog_manager.cc:1259] Loaded cluster ID: d4305653a1164035baaf011fd1089b2c
I20260806 18:39:39.068127 23249 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: loading cluster ID for follower catalog manager: success
I20260806 18:39:39.070570 23249 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: acquiring CA information for follower catalog manager: success
I20260806 18:39:39.072151 23249 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:39:39.093478 22528 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
W20260806 18:39:39.130586 23115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:39.130935 23115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:39.131029 23115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:39.135251 23115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:39.135347 23115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:39.135385 23115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:39.135439 23115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:39.135491 23115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:39.141546 23115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.188.keytab
--principal=oryx/127.12.177.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:44643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.177.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:39.142804 23115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:39.143925 23115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:39.153695 23259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.153721 23255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.153699 23257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.154116 23115 server_base.cc:1034] running on GCE node
I20260806 18:39:39.154819 23115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:39.156100 23115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:39.157299 23115 hybrid_clock.cc:648] HybridClock initialized: now 1786041579157263 us; error 53 us; skew 500 ppm
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:39.160503 23115 init.cc:377] Logged in from keytab as oryx/127.12.177.188@KRBTEST.COM (short username oryx)
I20260806 18:39:39.161608 23115 webserver.cc:460] Webserver started at http://127.12.177.188:42153/ using document root <none> and password file <none>
I20260806 18:39:39.162302 23115 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.162375 23115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.162569 23115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:39.164891 23115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/instance:
uuid: "60401753fc424c6ab67ef0b22d716ec2"
format_stamp: "Formatted at 2026-08-06 18:39:39 on dist-test-slave-j2vl"
server_key: "c9c7939ac2ddc9fc3c26d90f53518aa7"
server_key_iv: "6639dc527d60d68fbf3c73792c5ad68b"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.165656 23115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal/instance:
uuid: "60401753fc424c6ab67ef0b22d716ec2"
format_stamp: "Formatted at 2026-08-06 18:39:39 on dist-test-slave-j2vl"
server_key: "c9c7939ac2ddc9fc3c26d90f53518aa7"
server_key_iv: "6639dc527d60d68fbf3c73792c5ad68b"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.169903 23115 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:39.172684 23269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.174139 23115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:39.174258 23115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "60401753fc424c6ab67ef0b22d716ec2"
format_stamp: "Formatted at 2026-08-06 18:39:39 on dist-test-slave-j2vl"
server_key: "c9c7939ac2ddc9fc3c26d90f53518aa7"
server_key_iv: "6639dc527d60d68fbf3c73792c5ad68b"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.174413 23115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.195981 23115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:39.202791 23115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:39.203038 23115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:39.211232 23115 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.188:44643
I20260806 18:39:39.211546 23345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.188:44643 every 8 connection(s)
I20260806 18:39:39.212365 23115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
I20260806 18:39:39.212919 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 23115
I20260806 18:39:39.215689 23347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:39.219854 23347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.188@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:39.229684 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.214787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.12.177.188:44643)
0806 18:39:39.215214 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.215236 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.215280 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:39:39.216008 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.216027 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.216398 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.216755 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.217697 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.218705 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.219552 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.220022 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.220187 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.223302 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.223310 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.223323 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.223364 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.225562 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.226141 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.226148 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.226164 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.226346 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.226749 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.226755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.226758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.227314 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.227626 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.228133 (+ 507us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.228599 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"spinlock_wait_cycles":34688,"thread_start_us":146,"threads_started":1}
I20260806 18:39:39.234825 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.221988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.12.177.190:37033)
0806 18:39:39.222134 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.222139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.222339 (+ 200us) server_negotiation.cc:407] Connection header received
0806 18:39:39.222511 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.222514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.222564 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.222645 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.223421 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.224140 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.225597 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.225984 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.226122 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.229269 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.229272 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.229274 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.229303 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.231974 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.232976 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.232980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.232982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.233109 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.233723 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.233729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.233733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.234048 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.234155 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.234557 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.234684 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:39.234870 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.221721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51018)
0806 18:39:39.222219 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.222264 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.222402 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.222695 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.222701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.223084 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.223250 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.223259 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.224279 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.224285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.225428 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.225444 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.226153 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.226156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.226300 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.227027 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.227041 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.229097 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.232173 (+ 3076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.232183 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.232189 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.232804 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.233299 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.233302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.233304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.233570 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.234187 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.234194 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.234326 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.234478 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.234676 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"spinlock_wait_cycles":5376,"thread_start_us":192,"threads_started":1}
I20260806 18:39:39.236418 23347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.188@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
I20260806 18:39:39.247080 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.237050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46230)
0806 18:39:39.237209 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.237223 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.237299 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.237869 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.237872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.238057 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.238176 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.238182 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.239151 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.239154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.239752 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.239761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.240353 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.240360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.240471 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.241121 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.241136 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.242981 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.245192 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.245195 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.245197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.245644 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.245987 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.245990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.245991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.246092 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.246561 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.246564 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.246665 (+ 101us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.246762 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.246928 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 18:39:39.247140 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.237173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46230 (local address 127.12.177.189:37489)
0806 18:39:39.237581 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.237586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.237601 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:39.237643 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.237645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.237692 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.237785 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.238293 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.239013 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.239897 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.240147 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.240243 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.243186 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.243191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.243194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.243231 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.245041 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.245759 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.245763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.245764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.245861 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.246214 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.246217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.246218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.246445 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.246536 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.246884 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.247007 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":130,"threads_started":1}
I20260806 18:39:39.248019 23347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.188@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
I20260806 18:39:39.257233 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.248561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60426)
0806 18:39:39.248707 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.248721 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.248803 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.249056 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.249058 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.249240 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.249309 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.249315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.250602 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.250608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.251140 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.251148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.251605 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.251608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.251677 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.252199 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.252211 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.253721 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.255603 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.255606 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.255608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.255828 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.256147 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.256151 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.256152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.256241 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.256683 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.256686 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.256779 (+ 93us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.256895 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.257035 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 18:39:39.257242 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.248639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.12.177.188:44643)
0806 18:39:39.248744 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.248750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.248765 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:39.248921 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.248924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.248969 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.249045 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.249450 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.250450 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.251257 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.251495 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.251603 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.253883 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.253887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.253889 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.253912 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.255466 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.255938 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.255941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.255942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.256026 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.256331 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.256334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.256335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.256568 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.256656 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.256990 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.257102 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 18:39:39.260577 23347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Bootstrap starting.
I20260806 18:39:39.263468 23347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:39.264899 23347 log.cc:824] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:39.267268 23347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: No bootstrap required, opened a new log
I20260806 18:39:39.272001 23347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } }
I20260806 18:39:39.272318 23347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:39.272361 23347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60401753fc424c6ab67ef0b22d716ec2, State: Initialized, Role: FOLLOWER
I20260806 18:39:39.272802 23347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } }
I20260806 18:39:39.273447 23357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } } }
I20260806 18:39:39.273604 23357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:39.274286 23347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 18:39:39.280695 23375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:39:39.280824 23375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:39:39.284029 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 22330
I20260806 18:39:39.306977 23115 master_runner.cc:428] Detected that this master 60401753fc424c6ab67ef0b22d716ec2 is joining an existing cluster
I20260806 18:39:39.307111 23115 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.177.188:44643
I20260806 18:39:39.315995 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:34013
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:37033
--webserver_port=44421
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:39:39.322103 23385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.309884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51024)
0806 18:39:39.310692 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.310709 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.310856 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.311954 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.311957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.312152 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.312258 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.312268 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.313413 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.313416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.314711 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.314735 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.315531 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.315535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.315624 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.316583 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.316605 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.317198 (+ 593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.319778 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.319782 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.319784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.320315 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.320720 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.320727 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.320730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.320844 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.321462 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.321466 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.321585 (+ 119us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.321680 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.321856 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":168,"thread_start_us":114,"threads_started":1}
I20260806 18:39:39.323187 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.310979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51024 (local address 127.12.177.190:37033)
0806 18:39:39.311400 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.311404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.311419 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:39.311464 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.311467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.311513 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.311593 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.312410 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.313219 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.314881 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.315233 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.315324 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.317451 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.317458 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.317464 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.317502 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.319633 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.320477 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.320480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.320483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.320582 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.320982 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.320986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.320988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.321266 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.322786 (+ 1520us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.322874 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.323033 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317}
I20260806 18:39:39.323422 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.310095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46246 (local address 127.12.177.189:37489)
0806 18:39:39.310752 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.310760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.311225 (+ 465us) server_negotiation.cc:407] Connection header received
0806 18:39:39.311417 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.311420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.311482 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.311541 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.312368 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.313219 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.314881 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.315242 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.315323 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.319572 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.319578 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.319584 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.319626 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.321384 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.321876 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.321880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.321881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.321972 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.322350 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.322356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.322358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.322610 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.322679 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.323087 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.323254 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551}
I20260806 18:39:39.324015 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.310256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46246)
0806 18:39:39.311121 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.311137 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.311297 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.311716 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.311720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.312028 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.312190 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.312198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.313413 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.313416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.314712 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.314735 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.318249 (+ 3514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.318254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.318397 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.318813 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.318833 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.319344 (+ 511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.321498 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.321501 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.321502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.321740 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.322085 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.322087 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.322089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.322228 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.322758 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.322761 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.322874 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.323644 (+ 770us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.323828 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":146,"thread_start_us":124,"threads_started":1}
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041577, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.190@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
I20260806 18:39:39.337862 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.328201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60434)
0806 18:39:39.328352 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.328368 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.328476 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.328883 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.328886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.329106 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.329205 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.329211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.330096 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.330100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.330672 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.330682 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.331194 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.331198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.331322 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.331892 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.331906 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.333331 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.335703 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.335707 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.335710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.336004 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.336318 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.336322 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.336324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.336419 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.336887 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.336892 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.337317 (+ 425us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.337456 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.337643 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 18:39:39.338954 23387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.328262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.12.177.188:44643)
0806 18:39:39.328588 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.328596 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.328610 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:39.328678 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.328680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.328768 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.328864 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.329333 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.329985 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.330805 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.331070 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.331184 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.333578 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.333582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.333585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.333617 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.335560 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.336125 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.336128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.336130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.336216 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.336535 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.336538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.336539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.336767 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.338447 (+ 1680us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.338538 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.338693 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":168,"threads_started":1}
I20260806 18:39:39.340376 22237 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.177.188:44643: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2"
member_type: NON_VOTER
last_known_addr {
host: "127.12.177.188"
port: 44643
}
attrs {
promote: true
}
}
dest_uuid: "0908f1618b25418bbdc39aa2ec9f166c"
cas_config_opid_index: 5
I20260806 18:39:39.341049 22237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } }
I20260806 18:39:39.342698 23383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.310412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60430)
0806 18:39:39.315252 (+ 4840us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.315271 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.315419 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.315691 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.315694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.333747 (+ 18053us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.333912 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.333925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.335043 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.335049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.335936 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.335948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.336726 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.336729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.336830 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.337318 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.337333 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.337807 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.339778 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.339781 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.339783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.339999 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.341470 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.341474 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.341477 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.341583 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.342063 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.342069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.342160 (+ 91us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.342324 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.342487 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4759,"thread_start_us":64,"threads_started":1}
I20260806 18:39:39.342931 23099 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.343506 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.311772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60430 (local address 127.12.177.188:44643)
0806 18:39:39.311898 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.311903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.315345 (+ 3442us) server_negotiation.cc:407] Connection header received
0806 18:39:39.315519 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.315522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.315564 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.315612 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.334049 (+ 18437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.334907 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.336072 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.336421 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.336522 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.337953 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.337957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.337960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.337985 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.339668 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.340094 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.340097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.340098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.340173 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.341690 (+ 1517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.341693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.341695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.341926 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.342026 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.343099 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.343327 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":55}
I20260806 18:39:39.344563 23099 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.177.188:44643
I20260806 18:39:39.344779 23099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.344907 23099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:39.346175 23115 master.cc:537] Master@127.12.177.188:44643 shutting down...
I20260806 18:39:39.346339 23304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:39.349619 22736 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
I20260806 18:39:39.349279 23304 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 18:39:39.351065 23388 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 18:39:39.353422 22217 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c -> Peer 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188:44643): Couldn't send request to peer 60401753fc424c6ab67ef0b22d716ec2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 18:39:39.355206 23115 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:39.355530 23115 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:39.355655 23115 tablet_replica.cc:330] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: stopping tablet replica
I20260806 18:39:39.359268 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.345508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46262 (local address 127.12.177.189:37489)
0806 18:39:39.345650 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.345655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.353157 (+ 7502us) server_negotiation.cc:407] Connection header received
0806 18:39:39.354008 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.354014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.354093 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.354191 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:39.354687 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.355531 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.357397 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.358143 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.358273 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.358456 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.359013 (+ 557us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.359124 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:39:39.359611 23383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.359143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60440)
0806 18:39:39.359457 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.359537 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:44643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260806 18:39:39.360198 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.345391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46262)
0806 18:39:39.353066 (+ 7675us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.353085 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.353865 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.354358 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.354364 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.354390 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:39.354521 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.354532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.355857 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.355860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.357133 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.357147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.358585 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.358589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.358689 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.358850 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.359810 (+ 960us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.360013 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7568}
I20260806 18:39:39.361145 23185 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 LEARNER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 18:39:39.361855 23388 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 18:39:39.364177 23115 master.cc:552] Master@127.12.177.188:44643 shutdown complete.
I20260806 18:39:39.364234 23115 master_runner.cc:305] Clearing existing system tablet
I20260806 18:39:39.364507 23115 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.364563 23115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.364355 23185 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.366559 23233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.366704 23233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: LEARNER
I20260806 18:39:39.366542 23394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0908f1618b25418bbdc39aa2ec9f166c. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: NON_VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: true } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.366845 23394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: LEARNER
I20260806 18:39:39.369760 23115 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260806 18:39:39.370697 23395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.370927 23115 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.371083 23115 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:39.371122 23115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "60401753fc424c6ab67ef0b22d716ec2"
format_stamp: "Formatted at 2026-08-06 18:39:39 on dist-test-slave-j2vl"
server_key: "c9c7939ac2ddc9fc3c26d90f53518aa7"
server_key_iv: "6639dc527d60d68fbf3c73792c5ad68b"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.372942 23115 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:39.375491 23388 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: attempting to promote NON_VOTER 7be86214a241446a953a80c67fafbb7d to VOTER
I20260806 18:39:39.376031 23115 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 18:39:39.376247 23115 log.cc:1196] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 18:39:39.376327 23388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } }
I20260806 18:39:39.376545 23115 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Deleting consensus metadata
I20260806 18:39:39.376721 23115 master_runner.cc:315] Copying system tablet from 127.12.177.190:37033
I20260806 18:39:39.378265 23115 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.177.190:37033
I20260806 18:39:39.378706 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.377790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60450)
0806 18:39:39.378506 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.378601 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:44643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":622}
I20260806 18:39:39.379657 23185 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 LEARNER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 18:39:39.380878 23099 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 18:39:39.382066 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.381767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60452)
0806 18:39:39.381904 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.381958 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:44643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 18:39:39.382889 22217 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c -> Peer 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188:44643): Couldn't send request to peer 60401753fc424c6ab67ef0b22d716ec2. Status: Network error: Client connection negotiation failed: client connection to 127.12.177.188:44643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 18:39:39.384143 23099 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7be86214a241446a953a80c67fafbb7d (127.12.177.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.386127 23099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.386274 23099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:39.386452 23099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.386560 23099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:39.387914 23185 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7be86214a241446a953a80c67fafbb7d (127.12.177.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.389568 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.379009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51030 (local address 127.12.177.190:37033)
0806 18:39:39.379135 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.379140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.379776 (+ 636us) server_negotiation.cc:407] Connection header received
0806 18:39:39.380106 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.380110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.380167 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.380222 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.381158 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.381954 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.383097 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.383401 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.383488 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.385118 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.385122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.385125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.385152 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.387109 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.387766 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.387769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.387771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.387884 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.388363 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.388369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.388374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.388615 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.388690 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.389076 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.389221 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 18:39:39.390313 23402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.379241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51030)
0806 18:39:39.379663 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.379680 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.379948 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.380427 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.380430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.380858 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.381014 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.381024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.382103 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.382109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.382954 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.382967 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.383672 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.383675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.383787 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.384452 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.384468 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.384959 (+ 491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.387273 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.387278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.387283 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.387640 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.388107 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.388111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.388113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.388238 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.388768 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.388771 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.388886 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.389775 (+ 889us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.390100 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":122,"threads_started":1}
I20260806 18:39:39.390403 23394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.390561 23394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:39.390779 22270 tablet_copy_service.cc:140] P 0908f1618b25418bbdc39aa2ec9f166c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 60401753fc424c6ab67ef0b22d716ec2 ({username='oryx', principal='oryx/127.12.177.188@KRBTEST.COM'} at 127.0.0.1:51030)
I20260806 18:39:39.390863 22270 tablet_copy_service.cc:161] P 0908f1618b25418bbdc39aa2ec9f166c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 60401753fc424c6ab67ef0b22d716ec2 at {username='oryx', principal='oryx/127.12.177.188@KRBTEST.COM'} at 127.0.0.1:51030: session id = 60401753fc424c6ab67ef0b22d716ec2-00000000000000000000000000000000
I20260806 18:39:39.391948 22270 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 18:39:39.393321 23115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 18:39:39.396073 23115 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: tablet copy: Starting download of 0 data blocks...
I20260806 18:39:39.396333 23115 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: tablet copy: Starting download of 1 WAL segments...
I20260806 18:39:39.398175 23115 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 18:39:39.400054 22270 tablet_copy_service.cc:342] P 0908f1618b25418bbdc39aa2ec9f166c: Request end of tablet copy session 60401753fc424c6ab67ef0b22d716ec2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.177.188@KRBTEST.COM'} at 127.0.0.1:51030
I20260806 18:39:39.400170 22270 tablet_copy_service.cc:433] P 0908f1618b25418bbdc39aa2ec9f166c: ending tablet copy session 60401753fc424c6ab67ef0b22d716ec2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 60401753fc424c6ab67ef0b22d716ec2
I20260806 18:39:39.407855 23115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:39.409876 23403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.410229 23406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.410547 23115 server_base.cc:1034] running on GCE node
W20260806 18:39:39.413545 23404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.413938 23115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:39.414335 23115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:39.415470 23115 hybrid_clock.cc:648] HybridClock initialized: now 1786041579415455 us; error 39 us; skew 500 ppm
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:39.422286 23115 init.cc:377] Logged in from keytab as oryx/127.12.177.188@KRBTEST.COM (short username oryx)
I20260806 18:39:39.422907 23115 webserver.cc:460] Webserver started at http://127.12.177.188:40071/ using document root <none> and password file <none>
I20260806 18:39:39.423135 23115 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.423192 23115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.424440 23115 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:39.425666 23415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.426174 23115 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:39.426278 23115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "60401753fc424c6ab67ef0b22d716ec2"
format_stamp: "Formatted at 2026-08-06 18:39:39 on dist-test-slave-j2vl"
server_key: "c9c7939ac2ddc9fc3c26d90f53518aa7"
server_key_iv: "6639dc527d60d68fbf3c73792c5ad68b"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.426411 23115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.439494 23115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:39.441799 23115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:39.446874 23115 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.188:44643
I20260806 18:39:39.446879 23498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.188:44643 every 8 connection(s)
I20260806 18:39:39.447489 23115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
I20260806 18:39:39.448923 23499 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:39:39.449985 23499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Bootstrap starting.
I20260806 18:39:39.459681 23499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:39:39.460045 23499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: Bootstrap complete.
I20260806 18:39:39.460608 23499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } }
I20260806 18:39:39.460759 23499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 60401753fc424c6ab67ef0b22d716ec2, State: Initialized, Role: LEARNER
I20260806 18:39:39.460883 23499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } }
I20260806 18:39:39.461287 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.461496 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: LEARNER
I20260806 18:39:39.461478 23499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:39.465161 23519 catalog_manager.cc:1259] Loaded cluster ID: d4305653a1164035baaf011fd1089b2c
I20260806 18:39:39.465318 23519 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: loading cluster ID for follower catalog manager: success
I20260806 18:39:39.467459 23519 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: acquiring CA information for follower catalog manager: success
I20260806 18:39:39.468709 23519 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 18:39:39.510341 23386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:39.510795 23386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:39.510874 23386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:39.517009 23386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:39.517119 23386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:39.517208 23386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:39.526856 23386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:34013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=44421
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:39.528889 23386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:39.530612 23386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:39.543843 23531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.544071 23386 server_base.cc:1034] running on GCE node
W20260806 18:39:39.544123 23536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.544881 23528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.545507 23386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:39.546496 23386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:39.547761 23386 hybrid_clock.cc:648] HybridClock initialized: now 1786041579547740 us; error 43 us; skew 500 ppm
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:39.551683 23386 init.cc:377] Logged in from keytab as oryx/127.12.177.129@KRBTEST.COM (short username oryx)
I20260806 18:39:39.552850 23386 webserver.cc:460] Webserver started at http://127.12.177.129:44421/ using document root <none> and password file <none>
I20260806 18:39:39.553601 23386 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.553735 23386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.558892 23386 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:39:39.561910 23546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.563925 23386 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:39:39.564085 23386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "9c4202e0f95149ad8e3e7bee46d4222a"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "8c420af8c9605c1d7c3e14ab2b873537"
server_key_iv: "c90f88961a19c91c286d7371792e0022"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.564744 23386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.579411 23386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:39.583695 23386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:39.583962 23386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:39.584896 23386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:39.586196 23386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:39.586253 23386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.586300 23386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:39.586316 23386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.603515 22940 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
I20260806 18:39:39.606186 23386 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:34013
I20260806 18:39:39.606200 23705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:34013 every 8 connection(s)
I20260806 18:39:39.607511 23386 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:39.612751 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 23386
I20260806 18:39:39.612998 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 22534
I20260806 18:39:39.637912 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:45843
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:37033
--webserver_port=44989
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:39.647432 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.610065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:55921 (local address 127.12.177.188:44643)
0806 18:39:39.610368 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.610371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.611995 (+ 1624us) server_negotiation.cc:407] Connection header received
0806 18:39:39.630743 (+ 18748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.630746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.630822 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.630907 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.633930 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.635061 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.637426 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.637675 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.637739 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.642050 (+ 4311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.642061 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.642065 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.642105 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.644348 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645115 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.645119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.645121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.645223 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645767 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.645771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.645774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.646057 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.646163 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.647046 (+ 883us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.647218 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":150,"threads_started":1}
I20260806 18:39:39.647498 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.610012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:60515 (local address 127.12.177.189:37489)
0806 18:39:39.610184 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.610189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.611995 (+ 1806us) server_negotiation.cc:407] Connection header received
0806 18:39:39.630597 (+ 18602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.630604 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.630692 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.630756 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.633926 (+ 3170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.634855 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.637495 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.637851 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.637959 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.641912 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.641919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.641925 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.641965 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.644172 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645116 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.645124 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.645127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.645238 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645986 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.645992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.645996 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.646298 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.646420 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.647071 (+ 651us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.647243 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:39:39.647579 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.612488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:45179 (local address 127.12.177.190:37033)
0806 18:39:39.612637 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.612641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.630464 (+ 17823us) server_negotiation.cc:407] Connection header received
0806 18:39:39.630701 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.630706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.630766 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.630825 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.633931 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.634794 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.640063 (+ 5269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.640328 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.640464 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.643766 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.643773 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.643778 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.643831 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.645696 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.646200 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.646204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.646206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.646308 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.646611 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.646627 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.646629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.646856 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.646957 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.647298 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.647424 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:39:39.649528 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.612366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:45179)
0806 18:39:39.630243 (+ 17877us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.630273 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.630575 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.631282 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.631284 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.632284 (+ 1000us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.633693 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.633719 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.635054 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.635057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.637247 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.637259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.640611 (+ 3352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.640614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.640683 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.641389 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.641407 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.643548 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.645844 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.645849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.646076 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.646420 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.646423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.646424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.646508 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.647018 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.647021 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.647111 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.648337 (+ 1226us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.648472 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17744,"mutex_wait_us":433,"spinlock_wait_cycles":2944,"thread_start_us":168,"threads_started":1}
I20260806 18:39:39.649528 23713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.610833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.12.177.129:55921)
0806 18:39:39.611791 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.611864 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.630222 (+ 18358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.631236 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.631240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.632288 (+ 1048us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.633693 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.633719 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.635264 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.635268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.637247 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.637259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.637939 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.637942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.638178 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.638917 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.638943 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.641666 (+ 2723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.644499 (+ 2833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.644504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.644507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.644974 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.645402 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.645408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.645636 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.646254 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.646264 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.646701 (+ 437us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.647633 (+ 932us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.648147 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":621,"spinlock_wait_cycles":101888,"thread_start_us":379,"threads_started":1}
I20260806 18:39:39.649638 23712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.610833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.12.177.129:60515)
0806 18:39:39.611791 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.611864 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.630217 (+ 18353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.631213 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.631228 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.632303 (+ 1075us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.633693 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.633720 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.635053 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.635059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.637302 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.637316 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.638145 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.638151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.638352 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.639060 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.639082 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.641667 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.644358 (+ 2691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.644369 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.644396 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.644968 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.645417 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.645423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.645427 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.645827 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.646496 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.646502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.646702 (+ 200us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.647823 (+ 1121us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.648256 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":415,"spinlock_wait_cycles":81408,"thread_start_us":353,"threads_started":1}
I20260806 18:39:39.651516 23706 heartbeater.cc:347] Connected to a master server at 127.12.177.188:44643
I20260806 18:39:39.651574 23707 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:39.651813 23706 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.652040 23708 heartbeater.cc:347] Connected to a master server at 127.12.177.189:37489
I20260806 18:39:39.651814 23707 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.652119 23708 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.652562 23707 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
I20260806 18:39:39.652563 23708 heartbeater.cc:511] Master 127.12.177.189:37489 requested a full tablet report, sending...
I20260806 18:39:39.652563 23706 heartbeater.cc:511] Master 127.12.177.188:44643 requested a full tablet report, sending...
I20260806 18:39:39.654261 22237 ts_manager.cc:194] Re-registered known tserver with Master: 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:39.654500 23445 ts_manager.cc:194] Registered new tserver with Master: 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:39.654516 23164 ts_manager.cc:194] Registered new tserver with Master: 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:39.655092 22237 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:45179
W20260806 18:39:39.779721 23716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:39.780069 23716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:39.780120 23716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:39.784511 23716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:39.784610 23716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:39.784744 23716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:39.791366 23716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:45843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=44989
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:39.792774 23716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:39.794055 23716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:39.805862 23726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:39.805819 23723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.805984 23716 server_base.cc:1034] running on GCE node
W20260806 18:39:39.806198 23722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:39.806699 23716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:39.807547 23716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:39.808799 23716 hybrid_clock.cc:648] HybridClock initialized: now 1786041579808780 us; error 36 us; skew 500 ppm
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:39.812417 23716 init.cc:377] Logged in from keytab as oryx/127.12.177.130@KRBTEST.COM (short username oryx)
I20260806 18:39:39.813694 23716 webserver.cc:460] Webserver started at http://127.12.177.130:44989/ using document root <none> and password file <none>
I20260806 18:39:39.814391 23716 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:39.814520 23716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:39.819365 23716 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:39.822120 23734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.823758 23716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:39.823961 23716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "2669b5432742417e8c4c861991e436ad"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "412b90ffcb1c69437d567660c802dcc6"
server_key_iv: "22c1d49d13a0ea71bd9ebe6fe51423b1"
server_key_version: "encryptionkey@0"
I20260806 18:39:39.824638 23716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:39.844956 23716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:39.849254 23716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:39.849586 23716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:39.850317 23716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:39.851356 23716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:39.851434 23716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.851507 23716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:39.851552 23716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:39.865576 23716 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:45843
I20260806 18:39:39.865697 23901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:45843 every 8 connection(s)
I20260806 18:39:39.866992 23716 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:39.868491 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 23716
I20260806 18:39:39.868709 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 22742
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
I20260806 18:39:39.901115 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.889477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45913 (local address 127.12.177.188:44643)
0806 18:39:39.889674 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.889679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.889850 (+ 171us) server_negotiation.cc:407] Connection header received
0806 18:39:39.890042 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.890045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.890105 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.890195 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.891068 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.891616 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.892500 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.892761 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.892884 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.895162 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.895166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.895169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.895204 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.897596 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.898584 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.898589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.898591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.898706 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.899297 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.899301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.899303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.899564 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.899631 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.900770 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.900936 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 18:39:39.901115 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.880940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:56847 (local address 127.12.177.190:37033)
0806 18:39:39.881257 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.881263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.881912 (+ 649us) server_negotiation.cc:407] Connection header received
0806 18:39:39.883578 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.883584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.883657 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.883713 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.886720 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.887468 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.889878 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.890192 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.890313 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.895299 (+ 4986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.895304 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.895307 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.895344 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.897693 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.898584 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.898589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.898591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.898826 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.899300 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.899303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.899304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.899813 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.899930 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.900770 (+ 840us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.900941 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:39:39.903153 23910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.889143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.12.177.130:45913)
0806 18:39:39.889746 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.889765 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.889937 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.890215 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.890218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.890567 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.890937 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.890950 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.891735 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.891741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.892359 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.892369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.892890 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.892894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.892990 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.893646 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.893659 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.894962 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.897789 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.897801 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.897828 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.898441 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.898978 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.898984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.898987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.899172 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.900001 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.900003 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.900419 (+ 416us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.901872 (+ 1453us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.902009 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":25,"spinlock_wait_cycles":14720,"thread_start_us":113,"threads_started":1}
I20260806 18:39:39.903153 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.878198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:56847)
0806 18:39:39.881688 (+ 3490us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.881768 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.883281 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.884186 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.884198 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.885093 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.886133 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.886159 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.887644 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.887649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.889463 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.889489 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.890525 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.890529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.891033 (+ 504us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.891906 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.891933 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.894927 (+ 2994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.897814 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.897816 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.897827 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.898441 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.898932 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.898939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.898943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.899172 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.899949 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.899960 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.900419 (+ 459us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.901375 (+ 956us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.901829 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3232,"mutex_wait_us":24,"spinlock_wait_cycles":14592,"thread_start_us":1510,"threads_started":1}
I20260806 18:39:39.908231 23902 heartbeater.cc:347] Connected to a master server at 127.12.177.188:44643
I20260806 18:39:39.908591 23902 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.908627 23905 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:39.908730 23905 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.909400 23902 heartbeater.cc:511] Master 127.12.177.188:44643 requested a full tablet report, sending...
Aug 06 18:39:39 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041579, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
I20260806 18:39:39.911356 23905 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
I20260806 18:39:39.911566 23445 ts_manager.cc:194] Registered new tserver with Master: 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:39.914757 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.901455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:55049 (local address 127.12.177.189:37489)
0806 18:39:39.901752 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.901759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.902321 (+ 562us) server_negotiation.cc:407] Connection header received
0806 18:39:39.902595 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.902602 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.902673 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.902742 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:39.903946 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.904600 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.905746 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.905996 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.906061 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.910501 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:39.910507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:39.910512 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:39.910549 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:39.912580 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.913142 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.913147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.913148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.913248 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:39.913630 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:39.913634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:39.913635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:39.913912 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:39.914000 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.914409 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.914561 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260806 18:39:39.915334 23913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.900826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.12.177.130:55049)
0806 18:39:39.902168 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.902191 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.902439 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.903004 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.903010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.903424 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:39.903714 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.903728 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.904730 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.904736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.905587 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.905598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.906246 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.906248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.906317 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.908174 (+ 1857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:39.908194 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:39.910287 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:39.912714 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.912719 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.912721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.913017 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.913398 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:39.913401 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:39.913403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:39.913509 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:39.914093 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:39.914096 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:39.914202 (+ 106us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.914970 (+ 768us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.915152 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"thread_start_us":208,"threads_started":1}
I20260806 18:39:39.915831 22237 ts_manager.cc:194] Re-registered known tserver with Master: 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:39.916337 23906 heartbeater.cc:347] Connected to a master server at 127.12.177.189:37489
I20260806 18:39:39.916595 23906 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:39.916694 22237 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:56847
I20260806 18:39:39.916947 23906 heartbeater.cc:511] Master 127.12.177.189:37489 requested a full tablet report, sending...
I20260806 18:39:39.918718 23164 ts_manager.cc:194] Registered new tserver with Master: 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:39.920053 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.910071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60456)
0806 18:39:39.910380 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:39.910399 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:39.910528 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:39.912589 (+ 2061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:39.912593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:39.912622 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:39.912753 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.912764 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.913912 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.913916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.915770 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:39.915784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.919307 (+ 3523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.919312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:39.919438 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.919461 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:39:39.919786 (+ 325us) client_negotiation.cc:240] Negotiation successful
0806 18:39:39.919915 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":93,"threads_started":1}
I20260806 18:39:39.920048 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:39.910488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60456 (local address 127.12.177.188:44643)
0806 18:39:39.912153 (+ 1665us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:39.912159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:39.912175 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:39.912226 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:39.912230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:39.912311 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:39.912424 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:39.912912 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.913750 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.917412 (+ 3662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:39.918065 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:39.918172 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:39.918332 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:39.919805 (+ 1473us) server_negotiation.cc:299] Negotiation successful
0806 18:39:39.919906 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1575}
I20260806 18:39:39.920953 23461 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 18:39:39.921123 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:35869
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:37033
--webserver_port=36231
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:39:39.921469 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0908f1618b25418bbdc39aa2ec9f166c. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:39.921645 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: LEARNER
W20260806 18:39:40.059872 23916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:40.060202 23916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:40.060278 23916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:40.065021 23916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:40.065126 23916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:40.065235 23916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:40.071462 23916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:35869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=36231
--tserver_master_addrs=127.12.177.190:37033,127.12.177.189:37489,127.12.177.188:44643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:40.072820 23916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:40.074009 23916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:40.085479 23931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:40.085520 23926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:40.085793 23924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:40.085693 23916 server_base.cc:1034] running on GCE node
I20260806 18:39:40.086373 23916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:40.087138 23916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:40.088346 23916 hybrid_clock.cc:648] HybridClock initialized: now 1786041580088325 us; error 32 us; skew 500 ppm
Aug 06 18:39:40 dist-test-slave-j2vl krb5kdc[22170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041580, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:40.091836 23916 init.cc:377] Logged in from keytab as oryx/127.12.177.131@KRBTEST.COM (short username oryx)
I20260806 18:39:40.092955 23916 webserver.cc:460] Webserver started at http://127.12.177.131:36231/ using document root <none> and password file <none>
I20260806 18:39:40.093703 23916 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:40.093832 23916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:40.098728 23916 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:40.101557 23942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:40.103188 23916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:39:40.103369 23916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "6b901e7a181549be9c16649bc9ace4fc"
format_stamp: "Formatted at 2026-08-06 18:39:38 on dist-test-slave-j2vl"
server_key: "a0e8d818d128f3a1a77f5675a9418f36"
server_key_iv: "57c7bc1b0464c6549551ff848abdbf1f"
server_key_version: "encryptionkey@0"
I20260806 18:39:40.104063 23916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:40.130734 23916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:40.134786 23916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:40.135074 23916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:40.135893 23916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:40.136906 23916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:40.137007 23916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:40.137089 23916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:40.137130 23916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:40.149137 23916 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:35869
I20260806 18:39:40.149374 24125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:35869 every 8 connection(s)
I20260806 18:39:40.150353 23916 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:40.151450 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 23916
Aug 06 18:39:40 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041580, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.189@KRBTEST.COM
Aug 06 18:39:40 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041580, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:40.166838 24145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.154367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51038 (local address 127.12.177.190:37033)
0806 18:39:40.154589 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.154593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.155181 (+ 588us) server_negotiation.cc:407] Connection header received
0806 18:39:40.155362 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.155365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.155417 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.155479 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.157255 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.158083 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.159300 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.159643 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.159723 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.162443 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.162447 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.162450 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.162477 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.164473 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.165000 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.165004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.165006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.165109 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.165504 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.165510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.165511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.165795 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.165932 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.166366 (+ 434us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.166581 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":86,"threads_started":1}
I20260806 18:39:40.168810 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.154812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60470 (local address 127.12.177.188:44643)
0806 18:39:40.156301 (+ 1489us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.156305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.156319 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:40.156363 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.156366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.156412 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.156543 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.158061 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.158888 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.161334 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.162003 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.162101 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.164213 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.164220 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.164225 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.164255 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.166194 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.166692 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.166695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.166697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.166787 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.167124 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.167128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.167130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.167554 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.167691 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.168443 (+ 752us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.168587 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1417,"thread_start_us":93,"threads_started":1}
Aug 06 18:39:40 dist-test-slave-j2vl krb5kdc[22170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041580, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.188@KRBTEST.COM
I20260806 18:39:40.172900 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.152544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:48447 (local address 127.12.177.190:37033)
0806 18:39:40.152855 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.152860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.153932 (+ 1072us) server_negotiation.cc:407] Connection header received
0806 18:39:40.155818 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.155822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.155867 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.155939 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.159196 (+ 3257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.159980 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.161267 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.161637 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.161719 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.167481 (+ 5762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.167484 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.167487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.167514 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.170218 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.170864 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.170868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.170870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.170967 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.171492 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.171498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.171501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.171744 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.171847 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.172610 (+ 763us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.172744 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260806 18:39:40.173602 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.152711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:54063 (local address 127.12.177.189:37489)
0806 18:39:40.152954 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.152959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.155951 (+ 2992us) server_negotiation.cc:407] Connection header received
0806 18:39:40.156145 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.156149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.156202 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.156256 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.158127 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.158925 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.160636 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.160870 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.160995 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.165193 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.165197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.165201 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.165234 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.167311 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.171432 (+ 4121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.171436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.171438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.171544 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.171864 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.171869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.171871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.172098 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.172181 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.172610 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.173406 (+ 796us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260806 18:39:40.174665 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.153025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:48447)
0806 18:39:40.153775 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.153829 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.155575 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.156398 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.156407 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.156953 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:40.157704 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.157723 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.160123 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.160126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.161124 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.161136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.161918 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.161921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.162091 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.164159 (+ 2068us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:40.164176 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:40.167204 (+ 3028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:40.170344 (+ 3140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.170349 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.170353 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.170712 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.171101 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.171105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.171108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.171343 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.171906 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:40.171915 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:40.172299 (+ 384us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.173275 (+ 976us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.173578 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"spinlock_wait_cycles":768,"thread_start_us":152,"threads_started":1}
I20260806 18:39:40.175364 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.154481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:33559 (local address 127.12.177.188:44643)
0806 18:39:40.154632 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.154639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.156978 (+ 2339us) server_negotiation.cc:407] Connection header received
0806 18:39:40.158289 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.158292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.158345 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.158397 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.162346 (+ 3949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.163177 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.167850 (+ 4673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.168192 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.168290 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.171100 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.171105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.171111 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.171137 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.173235 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.173855 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.173858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.173860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.173948 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.174284 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.174287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.174288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.174525 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.174611 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.175053 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.175183 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:39:40.175858 24139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.154100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.12.177.131:33559)
0806 18:39:40.156807 (+ 2707us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.156832 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.157078 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.158525 (+ 1447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.158528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.158709 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:40.158816 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.158822 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.164625 (+ 5803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.164629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.166776 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.166788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.168494 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.168498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.168603 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.169296 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:40.169311 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:40.170931 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:40.173394 (+ 2463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.173398 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.173399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.173711 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.174071 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.174077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.174080 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.174175 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.174676 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:40.174680 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:40.174804 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.175505 (+ 701us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.175673 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2630,"thread_start_us":86,"threads_started":1}
I20260806 18:39:40.176158 24128 heartbeater.cc:347] Connected to a master server at 127.12.177.190:37033
I20260806 18:39:40.176306 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.153817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46270 (local address 127.12.177.189:37489)
0806 18:39:40.155158 (+ 1341us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.155163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.155179 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:40.155231 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.155235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.155315 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.155432 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.157234 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.158135 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.167380 (+ 9245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.167737 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.167906 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.169874 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.169879 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.169881 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.169910 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.174310 (+ 4400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.174851 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.174855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.174856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.174952 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.175278 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.175281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.175283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.175515 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.175626 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.176011 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.176152 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1258,"thread_start_us":134,"threads_started":1}
I20260806 18:39:40.176414 24128 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:40.176568 24126 heartbeater.cc:347] Connected to a master server at 127.12.177.188:44643
I20260806 18:39:40.176642 24126 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:40.177100 24128 heartbeater.cc:511] Master 127.12.177.190:37033 requested a full tablet report, sending...
I20260806 18:39:40.177104 24126 heartbeater.cc:511] Master 127.12.177.188:44643 requested a full tablet report, sending...
I20260806 18:39:40.173719 22237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:40.178922 22237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:40.178983 23445 ts_manager.cc:194] Registered new tserver with Master: 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869)
I20260806 18:39:40.179059 22236 ts_manager.cc:194] Re-registered known tserver with Master: 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869)
I20260806 18:39:40.179594 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.153025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.12.177.131:54063)
0806 18:39:40.155776 (+ 2751us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.155791 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.156029 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.156413 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.156416 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.157884 (+ 1468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:40.157995 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.158002 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.159112 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.159117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.160523 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.160540 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.161069 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.161077 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.161296 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.161971 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:40.162046 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:40.164927 (+ 2881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:40.169106 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.169115 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.169143 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.171295 (+ 2152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.171666 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:40.171669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:40.171671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:40.171755 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:40.172242 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:40.172245 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:40.172318 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.172758 (+ 440us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.178268 (+ 5510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2648,"mutex_wait_us":26,"thread_start_us":112,"threads_started":1}
I20260806 18:39:40.179845 22236 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:48447
I20260806 18:39:40.180477 24131 heartbeater.cc:347] Connected to a master server at 127.12.177.189:37489
I20260806 18:39:40.180577 24131 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:40.180783 24131 heartbeater.cc:511] Master 127.12.177.189:37489 requested a full tablet report, sending...
I20260806 18:39:40.181592 23164 ts_manager.cc:194] Registered new tserver with Master: 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869)
I20260806 18:39:40.182452 23388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: NON_VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: true } } }
I20260806 18:39:40.182590 23388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:40.185971 24153 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: attempting to promote NON_VOTER 60401753fc424c6ab67ef0b22d716ec2 to VOTER
I20260806 18:39:40.186327 24153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } }
I20260806 18:39:40.189622 23461 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 LEARNER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 18:39:40.190200 24153 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 18:39:40.190595 23185 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Refusing update from remote peer 0908f1618b25418bbdc39aa2ec9f166c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 18:39:40.190979 24153 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 18:39:40.192909 24154 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.193516 23461 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.193703 23185 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.195485 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.195621 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:40.195524 24166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.195683 24166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:40.198254 24153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.198390 24153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:40.198550 23388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.198680 23388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:40.198652 24153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0908f1618b25418bbdc39aa2ec9f166c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:40.198757 24153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:40.203653 24167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.197452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:45843 (local address 127.0.0.1:48186)
0806 18:39:40.198477 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.198495 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.198592 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.199405 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.199411 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.199435 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.199559 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.199567 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.200846 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.200850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.202160 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.202171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.203202 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.203206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.203304 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.203332 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.203412 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.203492 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":52,"thread_start_us":246,"threads_started":1}
I20260806 18:39:40.203685 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.197133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35869 (local address 127.0.0.1:48100)
0806 18:39:40.197284 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.197301 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.197434 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.199807 (+ 2373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.199810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.199826 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.199913 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.199919 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.201108 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.201111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.202289 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.202297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.203297 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.203301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.203399 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.203424 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.203488 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.203566 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":37}
I20260806 18:39:40.203743 24168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.197658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48100 (local address 127.12.177.131:35869)
0806 18:39:40.198982 (+ 1324us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.198994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.199017 (+ 23us) server_negotiation.cc:407] Connection header received
0806 18:39:40.199095 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.199100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.199305 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.199840 (+ 535us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.200011 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.200989 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.202411 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.203188 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.203312 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.203457 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.203513 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.203598 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1210,"thread_start_us":129,"threads_started":1}
I20260806 18:39:40.203701 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.197897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48186 (local address 127.12.177.130:45843)
0806 18:39:40.198852 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.198867 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.198898 (+ 31us) server_negotiation.cc:407] Connection header received
0806 18:39:40.198987 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.198995 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.199250 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.199437 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.199691 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.200715 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.202314 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.203066 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.203198 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.203354 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.203445 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.203551 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":846,"thread_start_us":267,"threads_started":1}
I20260806 18:39:40.207031 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 63609798504440a6be7f99a46147f859 (DEFAULT_TABLE table=test-table [id=b929bc5b0c954a45afe8549749119841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:40.207430 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 63609798504440a6be7f99a46147f859 (DEFAULT_TABLE table=test-table [id=b929bc5b0c954a45afe8549749119841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:40.208451 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63609798504440a6be7f99a46147f859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:40.208451 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63609798504440a6be7f99a46147f859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:40.214690 24169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.197743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34013 (local address 127.0.0.1:50550)
0806 18:39:40.199545 (+ 1802us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.199558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.199655 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.200208 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.200211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.200228 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.200321 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.200326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.201580 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.201584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.202758 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.202769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.214149 (+ 11380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.214154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.214277 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.214304 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.214391 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.214504 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1744,"mutex_wait_us":23,"thread_start_us":126,"threads_started":1}
I20260806 18:39:40.215253 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.198320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.12.177.129:34013)
0806 18:39:40.198749 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.198759 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.199656 (+ 897us) server_negotiation.cc:407] Connection header received
0806 18:39:40.199758 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.199763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.199938 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.200077 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.200451 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.201445 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.202893 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.204509 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.213638 (+ 9129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.213863 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.214969 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.215105 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":90,"threads_started":1}
I20260806 18:39:40.217718 24172 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Bootstrap starting.
I20260806 18:39:40.218163 23611 tablet_service.cc:1467] Processing CreateTablet for tablet 63609798504440a6be7f99a46147f859 (DEFAULT_TABLE table=test-table [id=b929bc5b0c954a45afe8549749119841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:40.219025 24174 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Bootstrap starting.
I20260806 18:39:40.219512 23611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63609798504440a6be7f99a46147f859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:40.220968 24172 tablet_bootstrap.cc:654] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:40.221145 24174 tablet_bootstrap.cc:654] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:40.221906 24174 log.cc:824] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:40.221932 24172 log.cc:824] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:40.224264 24172 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: No bootstrap required, opened a new log
I20260806 18:39:40.224264 24174 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: No bootstrap required, opened a new log
I20260806 18:39:40.224520 24172 ts_tablet_manager.cc:1397] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260806 18:39:40.224586 24174 ts_tablet_manager.cc:1397] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260806 18:39:40.228754 24179 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Bootstrap starting.
I20260806 18:39:40.229696 24172 raft_consensus.cc:348] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.229696 24174 raft_consensus.cc:348] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.230015 24174 raft_consensus.cc:374] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:40.230015 24172 raft_consensus.cc:374] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:40.230080 24174 raft_consensus.cc:729] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2669b5432742417e8c4c861991e436ad, State: Initialized, Role: FOLLOWER
I20260806 18:39:40.230080 24172 raft_consensus.cc:729] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b901e7a181549be9c16649bc9ace4fc, State: Initialized, Role: FOLLOWER
I20260806 18:39:40.230594 24174 consensus_queue.cc:260] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.230594 24172 consensus_queue.cc:260] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.231390 24179 tablet_bootstrap.cc:654] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:40.231405 23905 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
I20260806 18:39:40.231768 24174 ts_tablet_manager.cc:1428] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 18:39:40.232659 24179 log.cc:824] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:40.235498 24179 tablet_bootstrap.cc:492] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: No bootstrap required, opened a new log
I20260806 18:39:40.235651 24172 ts_tablet_manager.cc:1428] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Time spent starting tablet: real 0.011s user 0.008s sys 0.001s
I20260806 18:39:40.236001 24179 ts_tablet_manager.cc:1397] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 18:39:40.237126 24128 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
I20260806 18:39:40.240382 24179 raft_consensus.cc:348] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.240700 24179 raft_consensus.cc:374] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:40.240764 24179 raft_consensus.cc:729] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4202e0f95149ad8e3e7bee46d4222a, State: Initialized, Role: FOLLOWER
I20260806 18:39:40.241228 24179 consensus_queue.cc:260] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.241986 23707 heartbeater.cc:503] Master 127.12.177.190:37033 was elected leader, sending a full tablet report...
I20260806 18:39:40.242913 24179 ts_tablet_manager.cc:1428] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
W20260806 18:39:40.360679 23709 tablet.cc:2369] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:40.390277 23907 tablet.cc:2369] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:40.402627 24132 tablet.cc:2369] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:40.567904 24184 raft_consensus.cc:482] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:40.568169 24184 raft_consensus.cc:504] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.569692 24184 leader_election.cc:288] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:40.570612 24181 raft_consensus.cc:482] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:40.570822 24181 raft_consensus.cc:504] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.572216 24181 leader_election.cc:288] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:40.575434 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.570683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42889 (local address 127.12.177.130:45843)
0806 18:39:40.570806 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.570813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.571046 (+ 233us) server_negotiation.cc:407] Connection header received
0806 18:39:40.571197 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.571202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.571257 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.571322 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.571636 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.572155 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.574086 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.574717 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.574834 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.574887 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.575210 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.575301 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 18:39:40.575471 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.570578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:45843 (local address 127.12.177.129:42889)
0806 18:39:40.570937 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.570948 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.571085 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.571383 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.571386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.571406 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.571514 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.571519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.572299 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.572306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.573957 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.573968 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.574984 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.574988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.575092 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.575114 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.575185 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.575280 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":28,"thread_start_us":124,"threads_started":1}
I20260806 18:39:40.576088 24168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.570182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:35811 (local address 127.12.177.131:35869)
0806 18:39:40.570406 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.570411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.570579 (+ 168us) server_negotiation.cc:407] Connection header received
0806 18:39:40.570835 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.570841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.570897 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.570951 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.571404 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.572157 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.574099 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.574777 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.574866 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.574916 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.575862 (+ 946us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.575953 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 18:39:40.576301 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2669b5432742417e8c4c861991e436ad" is_pre_election: true
I20260806 18:39:40.576534 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.570071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35869 (local address 127.12.177.129:35811)
0806 18:39:40.570449 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.570477 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.570681 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.571115 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.571118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.571138 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.571266 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.571272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.572324 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.572327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.573940 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.573950 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.575032 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.575036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.575706 (+ 670us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.575736 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.576294 (+ 558us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.576381 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":711,"thread_start_us":142,"threads_started":1}
I20260806 18:39:40.576581 23837 raft_consensus.cc:2454] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 0.
I20260806 18:39:40.577307 23549 leader_election.cc:302] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2669b5432742417e8c4c861991e436ad, 9c4202e0f95149ad8e3e7bee46d4222a; no voters:
I20260806 18:39:40.577447 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc" is_pre_election: true
I20260806 18:39:40.577697 24184 raft_consensus.cc:2781] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:40.577796 24184 raft_consensus.cc:482] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:40.577777 24053 raft_consensus.cc:2454] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 0.
I20260806 18:39:40.577852 24184 raft_consensus.cc:3037] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:40.578485 24189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.572392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35869 (local address 127.12.177.130:49057)
0806 18:39:40.573052 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.573068 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.573460 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.574478 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.574482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.574502 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.574623 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.574629 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.575603 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.575610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.576888 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.576900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.577994 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.578000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.578113 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.578151 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.578229 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.578308 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":37,"thread_start_us":224,"threads_started":1}
I20260806 18:39:40.578712 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.572833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:33401 (local address 127.12.177.129:34013)
0806 18:39:40.572939 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.572943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.573837 (+ 894us) server_negotiation.cc:407] Connection header received
0806 18:39:40.573983 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.573990 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.574051 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.574101 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.574485 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.575174 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.577429 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.577981 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.578084 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.578138 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.578495 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.578571 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":32}
I20260806 18:39:40.578835 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.572565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34013 (local address 127.12.177.130:33401)
0806 18:39:40.573532 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:40.573546 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:40.573848 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:40.574242 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:40.574255 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:40.574273 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:40.574356 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.574361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.575316 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.575319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.577262 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:40.577272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.578234 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.578237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:40.578346 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.578368 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:39:40.578476 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 18:39:40.578678 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":31,"thread_start_us":65,"threads_started":1}
I20260806 18:39:40.578866 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.572917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:49057 (local address 127.12.177.131:35869)
0806 18:39:40.574035 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.574057 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.574072 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:40.574110 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.574112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.574163 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.574330 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:40.574772 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.575457 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.577097 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.577709 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.577862 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.577922 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.578652 (+ 730us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.578736 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1025,"thread_start_us":341,"threads_started":1}
I20260806 18:39:40.579527 23648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "2669b5432742417e8c4c861991e436ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" is_pre_election: true
I20260806 18:39:40.579573 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "2669b5432742417e8c4c861991e436ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc" is_pre_election: true
I20260806 18:39:40.579728 24053 raft_consensus.cc:2454] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2669b5432742417e8c4c861991e436ad in term 0.
I20260806 18:39:40.579746 24184 raft_consensus.cc:504] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.580056 23648 raft_consensus.cc:2379] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2669b5432742417e8c4c861991e436ad in current term 1: Already voted for candidate 9c4202e0f95149ad8e3e7bee46d4222a in this term.
I20260806 18:39:40.580191 24184 leader_election.cc:288] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 election: Requested vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:40.580155 23738 leader_election.cc:302] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2669b5432742417e8c4c861991e436ad, 6b901e7a181549be9c16649bc9ace4fc; no voters:
I20260806 18:39:40.580531 24181 raft_consensus.cc:2781] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:40.580646 24181 raft_consensus.cc:482] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:40.580710 24181 raft_consensus.cc:3037] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:40.581053 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc"
I20260806 18:39:40.581122 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2669b5432742417e8c4c861991e436ad"
I20260806 18:39:40.581190 24053 raft_consensus.cc:3037] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:40.582264 24181 raft_consensus.cc:504] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.582620 23837 raft_consensus.cc:2379] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9c4202e0f95149ad8e3e7bee46d4222a in current term 1: Already voted for candidate 2669b5432742417e8c4c861991e436ad in this term.
I20260806 18:39:40.582669 24053 raft_consensus.cc:2454] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 1.
I20260806 18:39:40.582892 24181 leader_election.cc:288] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [CANDIDATE]: Term 1 election: Requested vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013)
I20260806 18:39:40.583247 23549 leader_election.cc:302] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b901e7a181549be9c16649bc9ace4fc, 9c4202e0f95149ad8e3e7bee46d4222a; no voters:
I20260806 18:39:40.583292 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "2669b5432742417e8c4c861991e436ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc"
I20260806 18:39:40.583449 24053 raft_consensus.cc:2379] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2669b5432742417e8c4c861991e436ad in current term 1: Already voted for candidate 9c4202e0f95149ad8e3e7bee46d4222a in this term.
I20260806 18:39:40.583545 24184 raft_consensus.cc:2781] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:40.583822 24184 raft_consensus.cc:686] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 LEADER]: Becoming Leader. State: Replica: 9c4202e0f95149ad8e3e7bee46d4222a, State: Running, Role: LEADER
I20260806 18:39:40.583880 23648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63609798504440a6be7f99a46147f859" candidate_uuid: "2669b5432742417e8c4c861991e436ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4202e0f95149ad8e3e7bee46d4222a"
I20260806 18:39:40.584239 23736 leader_election.cc:302] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2669b5432742417e8c4c861991e436ad; no voters: 6b901e7a181549be9c16649bc9ace4fc, 9c4202e0f95149ad8e3e7bee46d4222a
I20260806 18:39:40.584429 24181 raft_consensus.cc:2726] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 18:39:40.584497 24184 consensus_queue.cc:237] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:40.588811 22236 catalog_manager.cc:5495] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129). New cstate: current_term: 1 leader_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:40.661006 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.657030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.12.177.129:34013)
0806 18:39:40.657222 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.657226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.657243 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:39:40.657452 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.657455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.657525 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.657635 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:40.657891 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.658412 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.659389 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.659623 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.659737 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.660078 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:40.660573 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:40.660708 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.660773 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.660836 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 18:39:40.668263 24053 raft_consensus.cc:1261] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Refusing update from remote peer 9c4202e0f95149ad8e3e7bee46d4222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:40.668263 23837 raft_consensus.cc:1261] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Refusing update from remote peer 9c4202e0f95149ad8e3e7bee46d4222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:40.668994 24191 consensus_queue.cc:1035] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:40.669240 24184 consensus_queue.cc:1035] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:40.677975 24196 mvcc.cc:205] Tried to move back new op lower bound from 7315626314408132608 to 7315626314076835840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626314408132608}]
I20260806 18:39:40.681825 24198 mvcc.cc:205] Tried to move back new op lower bound from 7315626314408132608 to 7315626314076835840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626314408132608}]
I20260806 18:39:40.685647 24197 mvcc.cc:205] Tried to move back new op lower bound from 7315626314408132608 to 7315626314076835840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626314408132608}]
I20260806 18:39:40.695459 22236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:40.695725 22236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:40.701686 22236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0908f1618b25418bbdc39aa2ec9f166c: Sending DeleteTablet for 3 replicas of tablet 63609798504440a6be7f99a46147f859
I20260806 18:39:40.702791 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 63609798504440a6be7f99a46147f859 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:40 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:48100
I20260806 18:39:40.703444 23806 tablet_service.cc:1514] Processing DeleteTablet for tablet 63609798504440a6be7f99a46147f859 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:40 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:48186
I20260806 18:39:40.703920 23611 tablet_service.cc:1514] Processing DeleteTablet for tablet 63609798504440a6be7f99a46147f859 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:40 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:50550
I20260806 18:39:40.704610 24210 tablet_replica.cc:330] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: stopping tablet replica
I20260806 18:39:40.705060 24210 raft_consensus.cc:2229] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:40.705507 24210 raft_consensus.cc:2258] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:40.706120 24211 tablet_replica.cc:330] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: stopping tablet replica
I20260806 18:39:40.706346 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 22191
I20260806 18:39:40.706524 24211 raft_consensus.cc:2229] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:40.707155 24211 raft_consensus.cc:2258] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:40.712074 24210 ts_tablet_manager.cc:1905] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:40.716128 24210 ts_tablet_manager.cc:1918] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:40.716241 24210 log.cc:1196] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/63609798504440a6be7f99a46147f859
I20260806 18:39:40.716513 24210 ts_tablet_manager.cc:1939] T 63609798504440a6be7f99a46147f859 P 2669b5432742417e8c4c861991e436ad: Deleting consensus metadata
I20260806 18:39:40.716624 24211 ts_tablet_manager.cc:1905] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:40.721478 24211 ts_tablet_manager.cc:1918] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:40.721606 24211 log.cc:1196] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/63609798504440a6be7f99a46147f859
I20260806 18:39:40.721930 24211 ts_tablet_manager.cc:1939] T 63609798504440a6be7f99a46147f859 P 9c4202e0f95149ad8e3e7bee46d4222a: Deleting consensus metadata
I20260806 18:39:40.724984 24208 tablet_replica.cc:330] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: stopping tablet replica
I20260806 18:39:40.725440 24208 raft_consensus.cc:2229] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:40.725831 24208 raft_consensus.cc:2258] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:40.727974 24208 ts_tablet_manager.cc:1905] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:40.732115 24208 ts_tablet_manager.cc:1918] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:40.732302 24208 log.cc:1196] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/63609798504440a6be7f99a46147f859
I20260806 18:39:40.732734 24208 ts_tablet_manager.cc:1939] T 63609798504440a6be7f99a46147f859 P 6b901e7a181549be9c16649bc9ace4fc: Deleting consensus metadata
W20260806 18:39:40.735610 23550 connection.cc:535] server connection from 127.0.0.1:50550 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 18:39:40.736189 23946 connection.cc:535] server connection from 127.0.0.1:48100 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 18:39:40.736210 23736 connection.cc:535] server connection from 127.0.0.1:48186 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 18:39:40.737138 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.705731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.12.177.189:37489)
0806 18:39:40.718535 (+ 12804us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.718541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.724443 (+ 5902us) server_negotiation.cc:407] Connection header received
0806 18:39:40.724509 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.724512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.724573 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.724680 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.725881 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.726923 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.728824 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.729260 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.729402 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.731976 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.731983 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.731989 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.732035 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.734599 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.735257 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.735264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.735266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.735391 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.735753 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.735756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.735758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.736038 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.736186 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.736722 (+ 536us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.736912 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12646,"thread_start_us":103,"threads_started":1}
I20260806 18:39:40.749603 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.705678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60474 (local address 127.12.177.188:44643)
0806 18:39:40.714107 (+ 8429us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.714114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.737871 (+ 23757us) server_negotiation.cc:407] Connection header received
0806 18:39:40.738087 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.738093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.738164 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.738237 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.739269 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.740186 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.741612 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.742003 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.742088 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.744199 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.744203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.744206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.744238 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.746367 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.747193 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.747196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.747198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.747444 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.748321 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.748325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.748327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.748626 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.748760 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.749144 (+ 384us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.749297 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8158,"thread_start_us":71,"threads_started":1}
I20260806 18:39:40.753168 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.740584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.12.177.189:37489)
0806 18:39:40.740726 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.740733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.741858 (+ 1125us) server_negotiation.cc:407] Connection header received
0806 18:39:40.742029 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.742031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.742077 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.742134 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.744129 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.744920 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.746435 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.746829 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.746929 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.749102 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.749106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.749108 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.749136 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.751027 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.751598 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.751602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.751604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.751698 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.752013 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.752019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.752024 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.752282 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.752403 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.752794 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.752974 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:39:40.753876 24226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:40.741069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60476 (local address 127.12.177.188:44643)
0806 18:39:40.741514 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:40.741519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:40.741950 (+ 431us) server_negotiation.cc:407] Connection header received
0806 18:39:40.742000 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:40.742006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:40.742060 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:40.742142 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:40.743369 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.744202 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.745760 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:40.746145 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:40.746226 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:40.748126 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:40.748130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:40.748133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:40.748160 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:40.750889 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.751873 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.751876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.751878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.751983 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:40.752282 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:40.752286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:40.752288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:40.752566 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:40.752674 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:40.753554 (+ 880us) server_negotiation.cc:299] Negotiation successful
0806 18:39:40.753732 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":80,"threads_started":1}
I20260806 18:39:41.685141 24228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:41.684606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:47967)
0806 18:39:41.684897 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:41.685013 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":81,"threads_started":1}
W20260806 18:39:41.685883 23905 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:37033 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:41.686017 24229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:41.685130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:60055)
0806 18:39:41.685804 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:41.685905 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":76,"threads_started":1}
W20260806 18:39:41.686446 23707 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:37033 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:41.686681 24230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:41.686157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:43615)
0806 18:39:41.686487 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:41.686578 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":68,"threads_started":1}
W20260806 18:39:41.687008 24128 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:37033 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.201978 24231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0908f1618b25418bbdc39aa2ec9f166c)
I20260806 18:39:42.202183 24231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } }
I20260806 18:39:42.202536 24233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0908f1618b25418bbdc39aa2ec9f166c)
I20260806 18:39:42.202736 24233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } }
I20260806 18:39:42.203418 24231 leader_election.cc:288] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033), 7be86214a241446a953a80c67fafbb7d (127.12.177.189:37489)
I20260806 18:39:42.204095 24233 leader_election.cc:288] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033), 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188:44643)
I20260806 18:39:42.204198 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.203627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51506)
0806 18:39:42.203964 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.204057 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":70,"threads_started":1}
W20260806 18:39:42.204387 23418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.204742 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.203786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51522)
0806 18:39:42.204551 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.204642 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":77,"threads_started":1}
W20260806 18:39:42.204926 23142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.205555 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.205259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51524)
0806 18:39:42.205422 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.205482 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260806 18:39:42.205739 23418 leader_election.cc:334] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033): Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.206328 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.205621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51526)
0806 18:39:42.206204 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.206260 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260806 18:39:42.206442 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033): Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.208774 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.204288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:44643 (local address 127.0.0.1:60484)
0806 18:39:42.204652 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.204668 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:42.204762 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:42.205187 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:42.205190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:42.205210 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:42.205334 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.205376 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.206484 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.206488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.207699 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.207710 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.208388 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.208391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.208461 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.208483 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:39:42.208545 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 18:39:42.208630 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":2,"thread_start_us":63,"threads_started":1}
I20260806 18:39:42.208799 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.204518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60484 (local address 127.12.177.188:44643)
0806 18:39:42.204868 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.204875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.204891 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:42.204995 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.204997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.205040 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.205128 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:42.205514 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.206340 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.207825 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.208265 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.208393 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.208448 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.208578 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.208674 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":282,"thread_start_us":92,"threads_started":1}
I20260806 18:39:42.209276 23461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7be86214a241446a953a80c67fafbb7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "60401753fc424c6ab67ef0b22d716ec2" is_pre_election: true
I20260806 18:39:42.209472 24234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.203652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:37489 (local address 127.0.0.1:46302)
0806 18:39:42.204038 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.204054 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:42.204177 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:42.205517 (+ 1340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:42.205520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:42.205537 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:42.205678 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.205686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.206954 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.206958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.208123 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.208132 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.209065 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.209069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.209170 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.209190 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:39:42.209233 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 18:39:42.209284 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":62,"threads_started":1}
I20260806 18:39:42.209568 23461 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be86214a241446a953a80c67fafbb7d in term 1.
I20260806 18:39:42.209698 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.203778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46302 (local address 127.12.177.189:37489)
0806 18:39:42.204748 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.204752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.204766 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:42.204807 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.204813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.205383 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.206043 (+ 660us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:42.206249 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.206840 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.208240 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.208934 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.209413 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.209466 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.209504 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.209579 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":60,"threads_started":1}
I20260806 18:39:42.209959 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60401753fc424c6ab67ef0b22d716ec2, 7be86214a241446a953a80c67fafbb7d; no voters: 0908f1618b25418bbdc39aa2ec9f166c
I20260806 18:39:42.210099 23185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "60401753fc424c6ab67ef0b22d716ec2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7be86214a241446a953a80c67fafbb7d" is_pre_election: true
I20260806 18:39:42.210201 24233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 18:39:42.210260 24233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0908f1618b25418bbdc39aa2ec9f166c)
I20260806 18:39:42.210315 24233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:39:42.211377 24233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } }
I20260806 18:39:42.211627 23185 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60401753fc424c6ab67ef0b22d716ec2 in current term 2: Already voted for candidate 7be86214a241446a953a80c67fafbb7d in this term.
I20260806 18:39:42.211794 24233 leader_election.cc:288] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 election: Requested vote from peers 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033), 60401753fc424c6ab67ef0b22d716ec2 (127.12.177.188:44643)
I20260806 18:39:42.212203 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.211944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51528)
0806 18:39:42.212080 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.212144 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 18:39:42.212358 23461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7be86214a241446a953a80c67fafbb7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "60401753fc424c6ab67ef0b22d716ec2"
I20260806 18:39:42.212494 23461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:39:42.212543 23421 leader_election.cc:302] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60401753fc424c6ab67ef0b22d716ec2; no voters: 0908f1618b25418bbdc39aa2ec9f166c, 7be86214a241446a953a80c67fafbb7d
I20260806 18:39:42.213742 23461 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be86214a241446a953a80c67fafbb7d in term 2.
I20260806 18:39:42.213868 24231 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:39:42.214056 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60401753fc424c6ab67ef0b22d716ec2, 7be86214a241446a953a80c67fafbb7d; no voters:
I20260806 18:39:42.214169 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.213815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51530)
0806 18:39:42.214049 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.214106 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 18:39:42.214231 24233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 2 FOLLOWER]: Leader election won for term 2
I20260806 18:39:42.214488 24233 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [term 2 LEADER]: Becoming Leader. State: Replica: 7be86214a241446a953a80c67fafbb7d, State: Running, Role: LEADER
I20260806 18:39:42.214752 24233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } }
W20260806 18:39:42.215693 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033): Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
I20260806 18:39:42.216056 24247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7be86214a241446a953a80c67fafbb7d. Latest consensus state: current_term: 2 leader_uuid: "7be86214a241446a953a80c67fafbb7d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:42.216200 24247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:42.216516 24250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:42.218838 24250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:42.219247 24250 catalog_manager.cc:1259] Loaded cluster ID: d4305653a1164035baaf011fd1089b2c
I20260806 18:39:42.219295 24250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:42.219869 24250 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:42.220255 24250 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Loaded TSK: 0
I20260806 18:39:42.220973 24250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:39:42.231360 23164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:42.234644 23164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:42.238235 23461 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [term 2 FOLLOWER]: Refusing update from remote peer 7be86214a241446a953a80c67fafbb7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 18:39:42.238267 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.237851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51550)
0806 18:39:42.238057 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.238122 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 18:39:42.239169 24233 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 18:39:42.239540 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.239142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.0.0.1:51552)
0806 18:39:42.239275 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.239425 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 18:39:42.239712 23142 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d -> Peer 0908f1618b25418bbdc39aa2ec9f166c (127.12.177.190:37033): Couldn't send request to peer 0908f1618b25418bbdc39aa2ec9f166c. Status: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 18:39:42.241314 24231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7be86214a241446a953a80c67fafbb7d. Latest consensus state: current_term: 2 leader_uuid: "7be86214a241446a953a80c67fafbb7d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:42.241534 24231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:42.242728 24247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7be86214a241446a953a80c67fafbb7d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:42.242890 24247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:42.243391 24231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7be86214a241446a953a80c67fafbb7d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "0908f1618b25418bbdc39aa2ec9f166c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37033 } } peers { permanent_uuid: "7be86214a241446a953a80c67fafbb7d" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 37489 } attrs { promote: false } } peers { permanent_uuid: "60401753fc424c6ab67ef0b22d716ec2" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 44643 } attrs { promote: false } } }
I20260806 18:39:42.243530 24231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60401753fc424c6ab67ef0b22d716ec2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:39:42.255240 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.250035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34013 (local address 127.0.0.1:50556)
0806 18:39:42.250282 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.250295 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:42.250472 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:42.251314 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:42.251325 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:42.251342 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:42.251435 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.251441 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252490 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.252494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.253716 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.253747 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.254786 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.254793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.254895 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.254929 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 18:39:42.254984 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 18:39:42.255060 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":15,"thread_start_us":103,"threads_started":1}
I20260806 18:39:42.255869 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.250777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50556 (local address 127.12.177.129:34013)
0806 18:39:42.251051 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.251056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.251070 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:42.251127 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.251131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.251182 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.251301 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:42.251618 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252347 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.253921 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.254620 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.255559 (+ 939us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.255608 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.255639 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.255706 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":103,"threads_started":1}
I20260806 18:39:42.256075 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.249795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:45843 (local address 127.0.0.1:48202)
0806 18:39:42.250062 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.250076 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:42.250160 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:42.251172 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:42.251174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:42.251194 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:42.251284 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.251289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252336 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.252343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.254553 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.254562 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.255583 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.255587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.255675 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.255716 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 18:39:42.255769 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 18:39:42.255850 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":558}
I20260806 18:39:42.256270 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.249551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35869 (local address 127.0.0.1:48112)
0806 18:39:42.249680 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.249698 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:42.249784 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:42.250841 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:42.250844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:42.250862 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:42.250995 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.251001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252357 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.252360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.254311 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:42.254322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.255784 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.255788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:42.255890 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.255927 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 18:39:42.256009 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 18:39:42.256095 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":60}
I20260806 18:39:42.256604 23611 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 (DEFAULT_TABLE table=test-table [id=dbdd81575d2b48e9b2369e0f76484d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:42.256840 24262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.249973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.12.177.130:45843)
0806 18:39:42.250931 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.250937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.250954 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:39:42.251012 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.251014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.251067 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.251167 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:42.251427 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252186 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.254679 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.255436 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.256526 (+ 1090us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.256584 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.256620 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.256703 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":99,"threads_started":1}
I20260806 18:39:42.256846 24265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.250351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48112 (local address 127.12.177.131:35869)
0806 18:39:42.250624 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.250628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.250641 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:39:42.250688 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.250690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.250730 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.250829 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:42.251109 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.252175 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.254729 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.255658 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.255789 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.255839 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.256543 (+ 704us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.256642 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":92,"threads_started":1}
I20260806 18:39:42.256889 23611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9daba827ff470d889e4ef56a219cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:42.257498 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 (DEFAULT_TABLE table=test-table [id=dbdd81575d2b48e9b2369e0f76484d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:42.257593 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 (DEFAULT_TABLE table=test-table [id=dbdd81575d2b48e9b2369e0f76484d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:42.257787 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9daba827ff470d889e4ef56a219cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:42.257859 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9daba827ff470d889e4ef56a219cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:42.259606 24268 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a: Bootstrap starting.
I20260806 18:39:42.260699 24268 tablet_bootstrap.cc:654] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:42.260843 24270 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Bootstrap starting.
I20260806 18:39:42.261525 24269 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Bootstrap starting.
I20260806 18:39:42.261838 24270 tablet_bootstrap.cc:654] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:42.262606 24269 tablet_bootstrap.cc:654] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:42.263312 24270 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: No bootstrap required, opened a new log
I20260806 18:39:42.263427 24270 ts_tablet_manager.cc:1397] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:42.263845 24269 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: No bootstrap required, opened a new log
I20260806 18:39:42.263864 24270 raft_consensus.cc:348] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.263957 24269 ts_tablet_manager.cc:1397] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:42.264011 24270 raft_consensus.cc:374] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:42.264050 24270 raft_consensus.cc:729] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b901e7a181549be9c16649bc9ace4fc, State: Initialized, Role: FOLLOWER
I20260806 18:39:42.264179 24270 consensus_queue.cc:260] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.264479 24269 raft_consensus.cc:348] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.264618 24269 raft_consensus.cc:374] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:42.264657 24269 raft_consensus.cc:729] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2669b5432742417e8c4c861991e436ad, State: Initialized, Role: FOLLOWER
I20260806 18:39:42.264772 24269 consensus_queue.cc:260] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.265120 24270 ts_tablet_manager.cc:1428] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:42.265179 24269 ts_tablet_manager.cc:1428] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:42.267377 24131 heartbeater.cc:503] Master 127.12.177.189:37489 was elected leader, sending a full tablet report...
I20260806 18:39:42.267499 24268 tablet_bootstrap.cc:492] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a: No bootstrap required, opened a new log
I20260806 18:39:42.267608 24268 ts_tablet_manager.cc:1397] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260806 18:39:42.267717 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.264906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:36181)
0806 18:39:42.267087 (+ 2181us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.267163 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2100,"thread_start_us":108,"threads_started":1}
I20260806 18:39:42.268100 24268 raft_consensus.cc:348] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.268229 24268 raft_consensus.cc:374] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:42.268272 24268 raft_consensus.cc:729] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4202e0f95149ad8e3e7bee46d4222a, State: Initialized, Role: FOLLOWER
I20260806 18:39:42.268409 24268 consensus_queue.cc:260] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.268816 24268 ts_tablet_manager.cc:1428] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 18:39:42.269742 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.269121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:40429)
0806 18:39:42.269570 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.269637 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":130,"threads_started":1}
I20260806 18:39:42.270574 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.270211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:47807)
0806 18:39:42.270447 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.270501 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
I20260806 18:39:42.271467 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.270671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:41143)
0806 18:39:42.271333 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.271390 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":587}
I20260806 18:39:42.271756 23708 heartbeater.cc:503] Master 127.12.177.189:37489 was elected leader, sending a full tablet report...
I20260806 18:39:42.272212 23906 heartbeater.cc:503] Master 127.12.177.189:37489 was elected leader, sending a full tablet report...
I20260806 18:39:42.272406 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.265736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:58031)
0806 18:39:42.272202 (+ 6466us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.272272 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6361,"thread_start_us":101,"threads_started":1}
I20260806 18:39:42.273089 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.272842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:36207)
0806 18:39:42.272966 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.273021 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 18:39:42.302671 24283 raft_consensus.cc:482] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:42.302871 24283 raft_consensus.cc:504] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.303376 24283 leader_election.cc:288] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:42.303889 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9daba827ff470d889e4ef56a219cf1" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc" is_pre_election: true
I20260806 18:39:42.303962 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9daba827ff470d889e4ef56a219cf1" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2669b5432742417e8c4c861991e436ad" is_pre_election: true
I20260806 18:39:42.304087 24053 raft_consensus.cc:2454] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 0.
I20260806 18:39:42.304097 23837 raft_consensus.cc:2454] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 0.
I20260806 18:39:42.304436 23549 leader_election.cc:302] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2669b5432742417e8c4c861991e436ad, 9c4202e0f95149ad8e3e7bee46d4222a; no voters:
I20260806 18:39:42.304626 24283 raft_consensus.cc:2781] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:42.304692 24283 raft_consensus.cc:482] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:42.304741 24283 raft_consensus.cc:3037] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:42.305966 24283 raft_consensus.cc:504] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.306337 24283 leader_election.cc:288] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 election: Requested vote from peers 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869), 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843)
I20260806 18:39:42.306780 24053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9daba827ff470d889e4ef56a219cf1" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b901e7a181549be9c16649bc9ace4fc"
I20260806 18:39:42.306927 24053 raft_consensus.cc:3037] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:42.306877 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9daba827ff470d889e4ef56a219cf1" candidate_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2669b5432742417e8c4c861991e436ad"
I20260806 18:39:42.307101 23837 raft_consensus.cc:3037] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:42.308032 24053 raft_consensus.cc:2454] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 1.
I20260806 18:39:42.308316 23837 raft_consensus.cc:2454] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4202e0f95149ad8e3e7bee46d4222a in term 1.
I20260806 18:39:42.308377 23549 leader_election.cc:302] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b901e7a181549be9c16649bc9ace4fc, 9c4202e0f95149ad8e3e7bee46d4222a; no voters:
I20260806 18:39:42.308606 24283 raft_consensus.cc:2781] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:42.308871 24283 raft_consensus.cc:686] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [term 1 LEADER]: Becoming Leader. State: Replica: 9c4202e0f95149ad8e3e7bee46d4222a, State: Running, Role: LEADER
I20260806 18:39:42.309067 24283 consensus_queue.cc:237] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } }
I20260806 18:39:42.310119 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.309738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:44315)
0806 18:39:42.309945 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.310012 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260806 18:39:42.310930 23161 catalog_manager.cc:5495] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129). New cstate: current_term: 1 leader_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c4202e0f95149ad8e3e7bee46d4222a" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:42.325845 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.322291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.12.177.129:34013)
0806 18:39:42.322461 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:42.322464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:42.322518 (+ 54us) server_negotiation.cc:407] Connection header received
0806 18:39:42.322568 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:42.322578 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:42.322628 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:42.322762 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:42.323098 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.323656 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.324584 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:42.324883 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:42.324976 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:42.325238 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:42.325314 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:42.325435 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:42.325548 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 18:39:42.325605 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:39:42.328346 23837 raft_consensus.cc:1261] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Refusing update from remote peer 9c4202e0f95149ad8e3e7bee46d4222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:42.328405 24053 raft_consensus.cc:1261] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Refusing update from remote peer 9c4202e0f95149ad8e3e7bee46d4222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:42.328864 24283 consensus_queue.cc:1035] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2669b5432742417e8c4c861991e436ad" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:42.329082 24285 consensus_queue.cc:1035] T 0e9daba827ff470d889e4ef56a219cf1 P 9c4202e0f95149ad8e3e7bee46d4222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b901e7a181549be9c16649bc9ace4fc" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:42.331008 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.330448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:47035)
0806 18:39:42.330849 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.330916 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330}
I20260806 18:39:42.331110 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.330791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:58439)
0806 18:39:42.330969 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.331028 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 18:39:42.333384 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.333031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:55219)
0806 18:39:42.333190 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.333252 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 18:39:42.336153 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.334852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.131:55873)
0806 18:39:42.335984 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.336062 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1048}
I20260806 18:39:42.337100 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.336717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.129:60987)
0806 18:39:42.336956 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.337016 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260806 18:39:42.339001 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.338644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37033 (local address 127.12.177.130:34209)
0806 18:39:42.338857 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.338919 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 18:39:42.342116 23164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:42.342271 23164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:42.346056 23164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7be86214a241446a953a80c67fafbb7d: Sending DeleteTablet for 3 replicas of tablet 0e9daba827ff470d889e4ef56a219cf1
I20260806 18:39:42.346804 23806 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:42 UTC) from {username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:48202
I20260806 18:39:42.346802 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:42 UTC) from {username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:48112
I20260806 18:39:42.347206 23611 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9daba827ff470d889e4ef56a219cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:42 UTC) from {username='oryx', principal='oryx/127.12.177.189@KRBTEST.COM'} at 127.0.0.1:50556
I20260806 18:39:42.347373 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 23386
I20260806 18:39:42.347522 24305 tablet_replica.cc:330] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: stopping tablet replica
I20260806 18:39:42.347681 24305 raft_consensus.cc:2229] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:42.348040 24305 raft_consensus.cc:2258] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:42.348058 24304 tablet_replica.cc:330] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: stopping tablet replica
I20260806 18:39:42.348181 24304 raft_consensus.cc:2229] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:42.348326 24304 raft_consensus.cc:2258] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:42.352502 24304 ts_tablet_manager.cc:1905] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:42.354812 24305 ts_tablet_manager.cc:1905] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:42.356254 24304 ts_tablet_manager.cc:1918] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:42.356360 24304 log.cc:1196] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/0e9daba827ff470d889e4ef56a219cf1
I20260806 18:39:42.356647 24304 ts_tablet_manager.cc:1939] T 0e9daba827ff470d889e4ef56a219cf1 P 6b901e7a181549be9c16649bc9ace4fc: Deleting consensus metadata
I20260806 18:39:42.357561 23144 catalog_manager.cc:4841] TS 6b901e7a181549be9c16649bc9ace4fc (127.12.177.131:35869): tablet 0e9daba827ff470d889e4ef56a219cf1 (table test-table [id=dbdd81575d2b48e9b2369e0f76484d3e]) successfully deleted
I20260806 18:39:42.357720 24305 ts_tablet_manager.cc:1918] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:42.357808 24305 log.cc:1196] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/0e9daba827ff470d889e4ef56a219cf1
I20260806 18:39:42.358101 24305 ts_tablet_manager.cc:1939] T 0e9daba827ff470d889e4ef56a219cf1 P 2669b5432742417e8c4c861991e436ad: Deleting consensus metadata
I20260806 18:39:42.358824 23144 catalog_manager.cc:4841] TS 2669b5432742417e8c4c861991e436ad (127.12.177.130:45843): tablet 0e9daba827ff470d889e4ef56a219cf1 (table test-table [id=dbdd81575d2b48e9b2369e0f76484d3e]) successfully deleted
I20260806 18:39:42.370333 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 23716
I20260806 18:39:42.373126 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:42.370470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34013 (local address 127.0.0.1:50566)
0806 18:39:42.372924 (+ 2454us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:42.373006 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:34013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2327}
W20260806 18:39:42.378532 23142 catalog_manager.cc:4584] TS 9c4202e0f95149ad8e3e7bee46d4222a (127.12.177.129:34013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e9daba827ff470d889e4ef56a219cf1: Network error: Client connection negotiation failed: client connection to 127.12.177.129:34013: connect: Connection refused (error 111)
I20260806 18:39:42.384546 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 23916
I20260806 18:39:42.401962 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 22946
I20260806 18:39:42.422825 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 23115
2026-08-06T18:39:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6298 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:42 dist-test-slave-j2vl krb5kdc[24314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:42 dist-test-slave-j2vl krb5kdc[24314](info): set up 2 sockets
Aug 06 18:39:42 dist-test-slave-j2vl krb5kdc[24314](info): commencing operation
krb5kdc: starting...
W20260806 18:39:43.706375 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:43 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:43Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab.
Entry for principal oryx/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab.
I20260806 18:39:43.853845 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:40451
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab
--principal=oryx/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:40451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:43.987138 24334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:43.987562 24334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:43.987658 24334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:43.991993 24334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:43.992112 24334 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 18:39:43.992144 24334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:43.992190 24334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:43.992235 24334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:43.992273 24334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:43.998108 24334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:40451
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.190.keytab
--principal=oryx/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:40451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:43.999383 24334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:44.000560 24334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:44.010059 24341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.010152 24334 server_base.cc:1034] running on GCE node
W20260806 18:39:44.010097 24346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.010123 24343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.011077 24334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:44.012310 24334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:44.013504 24334 hybrid_clock.cc:648] HybridClock initialized: now 1786041584013476 us; error 42 us; skew 500 ppm
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:44.016568 24334 init.cc:377] Logged in from keytab as oryx/127.12.177.190@KRBTEST.COM (short username oryx)
I20260806 18:39:44.017652 24334 webserver.cc:460] Webserver started at http://127.12.177.190:46777/ using document root <none> and password file <none>
I20260806 18:39:44.018256 24334 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:44.018350 24334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:44.018605 24334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:44.020908 24334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "3921bb58da9a40b2b8093cbd4e0e7d44"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2125eec34518bed35cb30aba0d2bf55f"
server_key_iv: "50a9dcf1316f1783db1d8c0b01973c5a"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.021685 24334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "3921bb58da9a40b2b8093cbd4e0e7d44"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2125eec34518bed35cb30aba0d2bf55f"
server_key_iv: "50a9dcf1316f1783db1d8c0b01973c5a"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.028039 24334 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 18:39:44.031780 24354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.033730 24334 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260806 18:39:44.033955 24334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "3921bb58da9a40b2b8093cbd4e0e7d44"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2125eec34518bed35cb30aba0d2bf55f"
server_key_iv: "50a9dcf1316f1783db1d8c0b01973c5a"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.034138 24334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:44.049057 24334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:44.052961 24334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:44.053159 24334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:44.063984 24334 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:40451
I20260806 18:39:44.064028 24448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:40451 every 8 connection(s)
I20260806 18:39:44.065181 24334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:44.068570 24451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:44.074919 24451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Bootstrap starting.
I20260806 18:39:44.075116 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 24334
I20260806 18:39:44.075278 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:44.075598 12998 external_mini_cluster.cc:1428] Setting key 0b0fc4e96f3294f9769920902701df75
I20260806 18:39:44.077958 24451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:44.078954 24451 log.cc:824] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:44.082417 24451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: No bootstrap required, opened a new log
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:44.087127 24451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } }
I20260806 18:39:44.087481 24451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:44.087561 24451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3921bb58da9a40b2b8093cbd4e0e7d44, State: Initialized, Role: FOLLOWER
I20260806 18:39:44.088140 24451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } }
I20260806 18:39:44.088338 24451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:44.088414 24451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:44.088528 24451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:44.089953 24451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } }
I20260806 18:39:44.090378 24451 leader_election.cc:302] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3921bb58da9a40b2b8093cbd4e0e7d44; no voters:
I20260806 18:39:44.090793 24451 leader_election.cc:288] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:44.090878 24459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:44.091856 24459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [term 1 LEADER]: Becoming Leader. State: Replica: 3921bb58da9a40b2b8093cbd4e0e7d44, State: Running, Role: LEADER
I20260806 18:39:44.092338 24459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } }
I20260806 18:39:44.092464 24451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:44.094319 24461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } } }
I20260806 18:39:44.094317 24460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3921bb58da9a40b2b8093cbd4e0e7d44. Latest consensus state: current_term: 1 leader_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3921bb58da9a40b2b8093cbd4e0e7d44" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 40451 } } }
I20260806 18:39:44.094488 24461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:44.094488 24460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44 [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:44.094779 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.077103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.12.177.190:40451)
0806 18:39:44.077604 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.077623 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.077668 (+ 45us) server_negotiation.cc:407] Connection header received
0806 18:39:44.078616 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.078643 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.079109 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.079617 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.081091 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.082688 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.083636 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.084480 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.084683 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.087933 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.087940 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.087959 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.087997 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.090262 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.090897 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.090910 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.090917 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.091108 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.091446 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.091452 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.091457 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.092095 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.092302 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.093173 (+ 871us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.093587 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":193,"threads_started":1}
W20260806 18:39:44.099038 24482 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:39:44.099119 24482 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:39:44.099198 24477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:44.099911 24477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:44.106824 24477 catalog_manager.cc:1347] Generated new cluster ID: c565ab6ffb8045be8fdb84e7b835932c
I20260806 18:39:44.106927 24477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:44.117657 24477 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:44.118716 24477 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:44.124156 24477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Generated new TSK 0
I20260806 18:39:44.124933 24477 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
I20260806 18:39:44.161540 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:40451
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:44.295912 24488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:44.296206 24488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:44.296260 24488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:44.300392 24488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:44.300494 24488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:44.300539 24488 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:44.300572 24488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:44.306097 24488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:40451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:44.307235 24488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:44.308322 24488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:44.318987 24499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.319025 24497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.319043 24496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.319120 24488 server_base.cc:1034] running on GCE node
I20260806 18:39:44.319790 24488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:44.320505 24488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:44.321700 24488 hybrid_clock.cc:648] HybridClock initialized: now 1786041584321676 us; error 36 us; skew 500 ppm
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:44.328233 24488 init.cc:377] Logged in from keytab as oryx/127.12.177.129@KRBTEST.COM (short username oryx)
I20260806 18:39:44.329404 24488 webserver.cc:460] Webserver started at http://127.12.177.129:34929/ using document root <none> and password file <none>
I20260806 18:39:44.330035 24488 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:44.330109 24488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:44.330345 24488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:44.332677 24488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "6fd89aed56ce46cd88e1ce77c189be46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "1ebca67e93270fb287444a96439ce947"
server_key_iv: "2ff4dfdd2e2099bafc447dbd722b8664"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.333316 24488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "6fd89aed56ce46cd88e1ce77c189be46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "1ebca67e93270fb287444a96439ce947"
server_key_iv: "2ff4dfdd2e2099bafc447dbd722b8664"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.337663 24488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:44.340435 24509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.342070 24488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:44.342226 24488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "6fd89aed56ce46cd88e1ce77c189be46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "1ebca67e93270fb287444a96439ce947"
server_key_iv: "2ff4dfdd2e2099bafc447dbd722b8664"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.342353 24488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:44.379283 24488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:44.383744 24488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:44.384012 24488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:44.385924 24488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:44.385986 24488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.386034 24488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:44.386276 24488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:44.399438 24488 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:45095
I20260806 18:39:44.399582 24676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:45095 every 8 connection(s)
I20260806 18:39:44.400708 24488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:44.402735 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 24488
I20260806 18:39:44.402927 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:44.403079 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.386996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:38139 (local address 127.12.177.190:40451)
0806 18:39:44.387195 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.387202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.388222 (+ 1020us) server_negotiation.cc:407] Connection header received
0806 18:39:44.389203 (+ 981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.389208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.389277 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.389449 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.390867 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.391790 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.393366 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.393837 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.393982 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.397923 (+ 3941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.397927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.397929 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.397963 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.400239 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.400914 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.400944 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.400946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.401069 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.401544 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.401548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.401550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.401827 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.402067 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.402682 (+ 615us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.402876 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 18:39:44.403815 12998 external_mini_cluster.cc:1428] Setting key 34968c54b90d2598ad6e60bc69b6c36d
I20260806 18:39:44.404244 24520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.387452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.129:38139)
0806 18:39:44.387969 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.388027 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.388968 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.389653 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.389662 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.390141 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.390691 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.390706 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.391962 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.391966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.393218 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.393230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.394087 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.394093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.394339 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.395226 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.395245 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.397680 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.400446 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.400452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.400464 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.400788 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.401189 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.401193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.401195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.401417 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.402092 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.402098 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.402378 (+ 280us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.402568 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.402934 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":159,"threads_started":1}
I20260806 18:39:44.408236 24677 heartbeater.cc:347] Connected to a master server at 127.12.177.190:40451
I20260806 18:39:44.408463 24677 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:44.409286 24677 heartbeater.cc:511] Master 127.12.177.190:40451 requested a full tablet report, sending...
I20260806 18:39:44.411134 24370 ts_manager.cc:194] Registered new tserver with Master: 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095)
I20260806 18:39:44.412452 24370 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:38139
WARNING: no policy specified for oryx/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:44.418987 24685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.408460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.129:58433)
0806 18:39:44.409101 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.409117 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.409277 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.409742 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.409759 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.410041 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.410215 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.410226 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.411411 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.411418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.412522 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.412539 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.413475 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.413482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.413622 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.414301 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.414323 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.414903 (+ 580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.417199 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.417202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.417204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.417567 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.417891 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.417894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.417895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.417982 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.418438 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.418440 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.418578 (+ 138us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.418669 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.418810 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":130,"threads_started":1}
I20260806 18:39:44.419082 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.408999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:58433 (local address 127.12.177.190:40451)
0806 18:39:44.409125 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.409132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.409191 (+ 59us) server_negotiation.cc:407] Connection header received
0806 18:39:44.409436 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.409440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.409500 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.409565 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.410372 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.411225 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.412685 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.413127 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.413234 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.415102 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.415106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.415110 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.415145 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.417036 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.417668 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.417671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.417673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.417788 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.418097 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.418099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.418100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.418307 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.418389 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.418795 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.418934 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
I20260806 18:39:44.441488 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:40451
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:44.585912 24688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:44.586196 24688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:44.586269 24688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:44.590407 24688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:44.590476 24688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:44.590518 24688 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:44.590608 24688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:44.596665 24688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:40451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:44.597872 24688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:44.598932 24688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:44.609177 24699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.609177 24697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.609293 24701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.609440 24688 server_base.cc:1034] running on GCE node
I20260806 18:39:44.610024 24688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:44.610682 24688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:44.611872 24688 hybrid_clock.cc:648] HybridClock initialized: now 1786041584611836 us; error 50 us; skew 500 ppm
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:44.614969 24688 init.cc:377] Logged in from keytab as oryx/127.12.177.130@KRBTEST.COM (short username oryx)
I20260806 18:39:44.615911 24688 webserver.cc:460] Webserver started at http://127.12.177.130:34569/ using document root <none> and password file <none>
I20260806 18:39:44.616550 24688 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:44.616652 24688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:44.616955 24688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:44.619498 24688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "e5ec38edaf3b4370b815cb46d79beb46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2bf86c1314c1ae79da7b82d3407ee724"
server_key_iv: "117a8244c4ba4228017efd6565862dc5"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.620126 24688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "e5ec38edaf3b4370b815cb46d79beb46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2bf86c1314c1ae79da7b82d3407ee724"
server_key_iv: "117a8244c4ba4228017efd6565862dc5"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.624365 24688 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:44.627213 24710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.628728 24688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:44.628893 24688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "e5ec38edaf3b4370b815cb46d79beb46"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2bf86c1314c1ae79da7b82d3407ee724"
server_key_iv: "117a8244c4ba4228017efd6565862dc5"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.629025 24688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:44.644212 24688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:44.648272 24688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:44.648542 24688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:44.650305 24688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:44.650388 24688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.650465 24688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:44.650503 24688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:44.662497 24688 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:34639
I20260806 18:39:44.662582 24887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:34639 every 8 connection(s)
I20260806 18:39:44.663484 24688 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:44.666054 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.651413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:37535 (local address 127.12.177.190:40451)
0806 18:39:44.651588 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.651594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.652605 (+ 1011us) server_negotiation.cc:407] Connection header received
0806 18:39:44.653919 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.653923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.653993 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.654097 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.655591 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.656226 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.657659 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.657900 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.658024 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.661735 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.661739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.661742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.661781 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.663480 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.664228 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.664232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.664238 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.664324 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.664754 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.664760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.664764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.665007 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.665101 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.665764 (+ 663us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.665918 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 18:39:44.667102 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.651870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.130:37535)
0806 18:39:44.652389 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.652452 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.653678 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.654302 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.654309 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.654700 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.655416 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.655439 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.656383 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.656387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.657515 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.657527 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.658107 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.658115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.658401 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.659270 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.659299 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.661516 (+ 2217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.663652 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.663658 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.663674 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.664092 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.664424 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.664427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.664431 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.664604 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.665137 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.665143 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.665488 (+ 345us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.665672 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.666070 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":143,"threads_started":1}
I20260806 18:39:44.668617 24888 heartbeater.cc:347] Connected to a master server at 127.12.177.190:40451
I20260806 18:39:44.668823 24888 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:44.669480 24888 heartbeater.cc:511] Master 127.12.177.190:40451 requested a full tablet report, sending...
I20260806 18:39:44.670712 24370 ts_manager.cc:194] Registered new tserver with Master: e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639)
I20260806 18:39:44.670830 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 24688
I20260806 18:39:44.671000 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:44.671393 12998 external_mini_cluster.cc:1428] Setting key 01d246393eeb8453f051a8f96a54cd0e
I20260806 18:39:44.671514 24370 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:37535
I20260806 18:39:44.682058 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.671129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.130:36085)
0806 18:39:44.671535 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.671553 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.671659 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.672607 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.672610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.672859 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.673003 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.673014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.674071 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.674078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.675084 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.675102 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.675875 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.675879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.675957 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.676631 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.676645 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.677068 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.679959 (+ 2891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.679963 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.679965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.680222 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.680641 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.680644 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.680645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.680759 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.681513 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.681516 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.681627 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.681732 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.681892 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":130,"threads_started":1}
I20260806 18:39:44.682363 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.671874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:36085 (local address 127.12.177.190:40451)
0806 18:39:44.671995 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.671999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.672010 (+ 11us) server_negotiation.cc:407] Connection header received
0806 18:39:44.672043 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.672045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.672078 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.672174 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.673145 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.673922 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.675292 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.675728 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.675860 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.677277 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.677283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.677290 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.677329 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.679655 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.680348 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.680355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.680360 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.680476 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.680870 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.680877 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.680881 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.681319 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.681487 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.681829 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.682001 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for oryx/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
I20260806 18:39:44.710161 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:40451
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:44.840101 24900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:44.840425 24900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:44.840519 24900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:44.844949 24900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:44.845052 24900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:44.845135 24900 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 18:39:44.845214 24900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:44.851284 24900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.177.190:40451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:44.852526 24900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:44.853731 24900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:44.867604 24910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:44.867590 24908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.868005 24900 server_base.cc:1034] running on GCE node
W20260806 18:39:44.867590 24907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:44.868639 24900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:44.869601 24900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:44.870808 24900 hybrid_clock.cc:648] HybridClock initialized: now 1786041584870789 us; error 44 us; skew 500 ppm
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:44.874150 24900 init.cc:377] Logged in from keytab as oryx/127.12.177.131@KRBTEST.COM (short username oryx)
I20260806 18:39:44.875357 24900 webserver.cc:460] Webserver started at http://127.12.177.131:36989/ using document root <none> and password file <none>
I20260806 18:39:44.876148 24900 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:44.876228 24900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:44.876495 24900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:44.879446 24900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2040dfee30f2a52016f655c7efd4694a"
server_key_iv: "468c30d1c5af669d954ad3a34e710e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.880399 24900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2040dfee30f2a52016f655c7efd4694a"
server_key_iv: "468c30d1c5af669d954ad3a34e710e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.885004 24900 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:39:44.887924 24919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.889447 24900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 18:39:44.889573 24900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
format_stamp: "Formatted at 2026-08-06 18:39:44 on dist-test-slave-j2vl"
server_key: "2040dfee30f2a52016f655c7efd4694a"
server_key_iv: "468c30d1c5af669d954ad3a34e710e99"
server_key_version: "encryptionkey@0"
I20260806 18:39:44.889693 24900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:44.904954 24900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:44.908912 24900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:44.909152 24900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:44.911235 24900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:44.911420 24900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 18:39:44.911517 24900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:44.911566 24900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:44.923620 24900 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:36499
I20260806 18:39:44.925621 25088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:36499 every 8 connection(s)
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:44.926244 24900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:44.931978 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 24900
I20260806 18:39:44.932144 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:44.932504 12998 external_mini_cluster.cc:1428] Setting key 0a6af5c41ad88f0a3cdc7fedc5fe4360
I20260806 18:39:44.932806 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.913128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:57303 (local address 127.12.177.190:40451)
0806 18:39:44.913309 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.913315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.914630 (+ 1315us) server_negotiation.cc:407] Connection header received
0806 18:39:44.916375 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.916379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.916459 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.916570 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.918631 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.919533 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.921810 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.922264 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.922404 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.927170 (+ 4766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.927177 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.927183 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.927242 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.929561 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.930378 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.930385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.930390 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.930512 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.930952 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.930958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.930962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.931292 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.931427 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.932356 (+ 929us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.932540 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:39:44.933954 24933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.913736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.131:57303)
0806 18:39:44.914387 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.914470 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.916081 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.916835 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.916848 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.917516 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.918399 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.918428 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.919746 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.919753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.921634 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.921653 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.922471 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.922477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.922762 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.923597 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.923629 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.926838 (+ 3209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.929790 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.929796 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.929813 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.930206 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.930630 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.930632 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.930634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.930832 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.931523 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.931533 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.931966 (+ 433us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.932225 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.932666 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":117,"threads_started":1}
I20260806 18:39:44.935302 25094 heartbeater.cc:347] Connected to a master server at 127.12.177.190:40451
I20260806 18:39:44.935489 25094 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:44.936060 25094 heartbeater.cc:511] Master 127.12.177.190:40451 requested a full tablet report, sending...
I20260806 18:39:44.937181 24370 ts_manager.cc:194] Registered new tserver with Master: 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:44.939643 24370 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:57303
I20260806 18:39:44.948179 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:39:44.950937 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.938973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59237 (local address 127.12.177.190:40451)
0806 18:39:44.939143 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.939151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.941747 (+ 2596us) server_negotiation.cc:407] Connection header received
0806 18:39:44.942136 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.942139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.942187 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.942422 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.943097 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.943735 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.945209 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.945552 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.945692 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.947409 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.947413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.947417 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.947452 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.949099 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.949641 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.949644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.949647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.949739 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.950030 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.950033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.950035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.950251 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.950363 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.950636 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.950754 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:39:44.950955 25100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.938835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.12.177.131:59237)
0806 18:39:44.941628 (+ 2793us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:44.941651 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:44.941842 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:44.942448 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:44.942453 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:44.942748 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:44.942931 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.942943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.943908 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.943915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.945026 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:44.945064 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.945719 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.945724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:44.945908 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.946559 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:44.946581 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:44.947257 (+ 676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:44.949224 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.949228 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.949230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.949535 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.949836 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:44.949839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:44.949841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:44.949936 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:44.950352 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:44.950355 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:44.950469 (+ 114us) client_negotiation.cc:769] Sending connection context
0806 18:39:44.950575 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 18:39:44.950765 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2659,"thread_start_us":119,"threads_started":1}
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 18:39:44.981510 24456 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:44.974946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43232 (local address 127.12.177.190:40451)
0806 18:39:44.975077 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.975080 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.975094 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:44.975137 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.975139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.975179 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.975305 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.976155 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.976694 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.977607 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.977830 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.977936 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.981301 (+ 3365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43232: BlockingRecv error: recv got EOF from 127.0.0.1:43232 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 18:39:44 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:44.994606 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:44.983489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43244 (local address 127.12.177.190:40451)
0806 18:39:44.983619 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:44.983623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:44.983813 (+ 190us) server_negotiation.cc:407] Connection header received
0806 18:39:44.983970 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:44.983973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:44.984019 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:44.984096 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:44.985017 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.985636 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.987020 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:44.987230 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:44.987309 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:44.990564 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:44.990568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:44.990570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:44.990603 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:44.992321 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.992906 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.992910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.992912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.993003 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:44.993378 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:44.993382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:44.993383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:44.993605 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:44.993826 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:44.994266 (+ 440us) server_negotiation.cc:299] Negotiation successful
0806 18:39:44.994413 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:39:44.998776 24370 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:45.004987 24370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:45.024569 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.016943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.12.177.129:45095)
0806 18:39:45.017315 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.017326 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.018247 (+ 921us) server_negotiation.cc:407] Connection header received
0806 18:39:45.018325 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.018329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.018524 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.018658 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.019501 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.020579 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.022591 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.023504 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.023612 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.023790 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.024271 (+ 481us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.024401 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":94,"threads_started":1}
I20260806 18:39:45.025261 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.017868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:36499 (local address 127.0.0.1:42548)
0806 18:39:45.019115 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.019130 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.019212 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.020658 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.020663 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.020689 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.020933 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.020944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.022458 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.022461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.023609 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.023620 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.024895 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.024898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.025007 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.025030 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.025095 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.025152 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"mutex_wait_us":78,"thread_start_us":133,"threads_started":1}
I20260806 18:39:45.025260 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.016031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45095 (local address 127.0.0.1:58624)
0806 18:39:45.017863 (+ 1832us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.017930 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.018092 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.018841 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.018848 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.018889 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.019372 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.019379 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.020717 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.020720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.022451 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.022459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.023886 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.023889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.024033 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.024075 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.024933 (+ 858us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.025096 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1641,"mutex_wait_us":459,"spinlock_wait_cycles":6016,"thread_start_us":112,"threads_started":1}
I20260806 18:39:45.026294 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.018405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.12.177.131:36499)
0806 18:39:45.019890 (+ 1485us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.019911 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.019945 (+ 34us) server_negotiation.cc:407] Connection header received
0806 18:39:45.020036 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.020044 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.020291 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.020477 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.021108 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.022296 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.023754 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.024579 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.025876 (+ 1297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.026014 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.026066 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.026159 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":128,"threads_started":1}
I20260806 18:39:45.026458 25127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.016128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:34639 (local address 127.0.0.1:53640)
0806 18:39:45.017863 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.017930 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.018097 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.018841 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.018848 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.018887 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.019076 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.019084 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.020676 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.020679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.023902 (+ 3223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.023917 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.025787 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.025794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.025953 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.025995 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.026081 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.026196 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1603,"mutex_wait_us":1520,"spinlock_wait_cycles":5760,"thread_start_us":86,"threads_started":1}
I20260806 18:39:45.027153 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.016940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53640 (local address 127.12.177.130:34639)
0806 18:39:45.017419 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.017432 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.018037 (+ 605us) server_negotiation.cc:407] Connection header received
0806 18:39:45.018286 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.018291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.018524 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.018656 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.019224 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.020520 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.024086 (+ 3566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.025174 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.025302 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.025635 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.026866 (+ 1231us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.026990 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":117,"threads_started":1}
I20260806 18:39:45.029003 24995 tablet_service.cc:1467] Processing CreateTablet for tablet a9d09cc09c974d94bf840bb037a46007 (DEFAULT_TABLE table=test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.028944 24569 tablet_service.cc:1467] Processing CreateTablet for tablet a9d09cc09c974d94bf840bb037a46007 (DEFAULT_TABLE table=test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.030176 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d09cc09c974d94bf840bb037a46007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.030218 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d09cc09c974d94bf840bb037a46007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.035310 24793 tablet_service.cc:1467] Processing CreateTablet for tablet a9d09cc09c974d94bf840bb037a46007 (DEFAULT_TABLE table=test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.036587 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9d09cc09c974d94bf840bb037a46007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.041772 25139 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Bootstrap starting.
I20260806 18:39:45.042266 25138 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Bootstrap starting.
I20260806 18:39:45.044998 25138 tablet_bootstrap.cc:654] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.046051 25138 log.cc:824] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:45.047227 25141 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Bootstrap starting.
I20260806 18:39:45.048904 25139 tablet_bootstrap.cc:654] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.049860 25139 log.cc:824] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:45.050468 25138 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: No bootstrap required, opened a new log
I20260806 18:39:45.050704 25138 ts_tablet_manager.cc:1397] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260806 18:39:45.050836 25141 tablet_bootstrap.cc:654] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.052047 25141 log.cc:824] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:45.052208 25139 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: No bootstrap required, opened a new log
I20260806 18:39:45.052474 25139 ts_tablet_manager.cc:1397] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260806 18:39:45.055161 25141 tablet_bootstrap.cc:492] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: No bootstrap required, opened a new log
I20260806 18:39:45.055429 25141 ts_tablet_manager.cc:1397] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 18:39:45.055773 25138 raft_consensus.cc:348] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.056097 25138 raft_consensus.cc:374] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.056160 25138 raft_consensus.cc:729] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd89aed56ce46cd88e1ce77c189be46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.056663 25139 raft_consensus.cc:348] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.056912 25139 raft_consensus.cc:374] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.056962 25139 raft_consensus.cc:729] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.057024 25138 consensus_queue.cc:260] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.057436 25139 consensus_queue.cc:260] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.058153 25138 ts_tablet_manager.cc:1428] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:39:45.058573 24677 heartbeater.cc:503] Master 127.12.177.190:40451 was elected leader, sending a full tablet report...
I20260806 18:39:45.058727 25094 heartbeater.cc:503] Master 127.12.177.190:40451 was elected leader, sending a full tablet report...
I20260806 18:39:45.059352 25139 ts_tablet_manager.cc:1428] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 18:39:45.060887 25141 raft_consensus.cc:348] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.061194 25141 raft_consensus.cc:374] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.061251 25141 raft_consensus.cc:729] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.061776 25141 consensus_queue.cc:260] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.062491 24888 heartbeater.cc:503] Master 127.12.177.190:40451 was elected leader, sending a full tablet report...
I20260806 18:39:45.062870 25141 ts_tablet_manager.cc:1428] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260806 18:39:45.152501 24678 tablet.cc:2369] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:45.165102 24889 tablet.cc:2369] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:39:45.178511 25095 tablet.cc:2369] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:39:45.528131 25150 raft_consensus.cc:482] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:45.528398 25150 raft_consensus.cc:504] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.529731 25150 leader_election.cc:288] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639)
I20260806 18:39:45.534332 25155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.530207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:49183 (local address 127.12.177.129:45095)
0806 18:39:45.530471 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.530477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.530570 (+ 93us) server_negotiation.cc:407] Connection header received
0806 18:39:45.530781 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.530784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.530830 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.530945 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.531298 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.531832 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533137 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.533688 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533840 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.533913 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.534099 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.534183 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
I20260806 18:39:45.534348 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.530047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45095 (local address 127.12.177.131:49183)
0806 18:39:45.530452 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.530469 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.530636 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.530966 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.530969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.530986 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.531180 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.531186 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.531959 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.531964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.532993 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.533004 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.533839 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.533953 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.533991 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.534081 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.534165 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":59,"spinlock_wait_cycles":384,"thread_start_us":93,"threads_started":1}
I20260806 18:39:45.534581 25154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.530167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:58365 (local address 127.12.177.130:34639)
0806 18:39:45.530495 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.530500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.530621 (+ 121us) server_negotiation.cc:407] Connection header received
0806 18:39:45.530779 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.530782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.530833 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.530925 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.531308 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.531835 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533142 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.533700 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533858 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.533904 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.534197 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.534292 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":62,"threads_started":1}
I20260806 18:39:45.535039 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.530047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:34639 (local address 127.12.177.131:58365)
0806 18:39:45.530507 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.530526 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.530669 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.530947 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.530950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.530967 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.531182 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.531188 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.531953 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.531957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.533004 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.533015 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.533961 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.533963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.534068 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.534087 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.534178 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.534292 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":177,"spinlock_wait_cycles":41728,"thread_start_us":65,"threads_started":1}
I20260806 18:39:45.535128 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d09cc09c974d94bf840bb037a46007" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46" is_pre_election: true
I20260806 18:39:45.535468 24601 raft_consensus.cc:2454] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 0.
I20260806 18:39:45.535637 24820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d09cc09c974d94bf840bb037a46007" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ec38edaf3b4370b815cb46d79beb46" is_pre_election: true
I20260806 18:39:45.535987 24820 raft_consensus.cc:2454] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 0.
I20260806 18:39:45.536079 24923 leader_election.cc:302] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, 6fd89aed56ce46cd88e1ce77c189be46; no voters:
I20260806 18:39:45.536394 25150 raft_consensus.cc:2781] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:45.536499 25150 raft_consensus.cc:482] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:45.536543 25150 raft_consensus.cc:3037] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.537711 25150 raft_consensus.cc:504] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.538074 25150 leader_election.cc:288] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639)
I20260806 18:39:45.538527 24820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d09cc09c974d94bf840bb037a46007" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ec38edaf3b4370b815cb46d79beb46"
I20260806 18:39:45.538626 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9d09cc09c974d94bf840bb037a46007" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46"
I20260806 18:39:45.538736 24601 raft_consensus.cc:3037] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.538728 24820 raft_consensus.cc:3037] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.539945 24601 raft_consensus.cc:2454] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 1.
I20260806 18:39:45.539964 24820 raft_consensus.cc:2454] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 1.
I20260806 18:39:45.540295 24923 leader_election.cc:302] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, 6fd89aed56ce46cd88e1ce77c189be46; no voters:
I20260806 18:39:45.540490 25150 raft_consensus.cc:2781] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:45.540705 25150 raft_consensus.cc:686] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 LEADER]: Becoming Leader. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Running, Role: LEADER
I20260806 18:39:45.541060 25150 consensus_queue.cc:237] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.544443 24368 catalog_manager.cc:5495] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:45.591854 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.587802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37522 (local address 127.12.177.131:36499)
0806 18:39:45.588109 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.588113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.588130 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:39:45.588314 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.588317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.588378 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.588507 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:45.588761 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.589293 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.590237 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.590469 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.590581 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.590892 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:45.591409 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:45.591543 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.591607 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.591669 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":86,"threads_started":1}
I20260806 18:39:45.598791 24820 raft_consensus.cc:1261] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Refusing update from remote peer 01602db7b3ef42e0b2a6bf9d65cab682: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:45.598790 24601 raft_consensus.cc:1261] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Refusing update from remote peer 01602db7b3ef42e0b2a6bf9d65cab682: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:45.599627 25150 consensus_queue.cc:1035] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:45.599884 25156 consensus_queue.cc:1035] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:45.608525 25172 mvcc.cc:205] Tried to move back new op lower bound from 7315626334604484608 to 7315626334379163648. Current Snapshot: MvccSnapshot[applied={T|T < 7315626334604484608}]
I20260806 18:39:45.614063 25173 mvcc.cc:205] Tried to move back new op lower bound from 7315626334604484608 to 7315626334379163648. Current Snapshot: MvccSnapshot[applied={T|T < 7315626334604484608 or (T in {7315626334604484608})}]
I20260806 18:39:45.617149 24370 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:45.617394 24370 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:45.620342 24370 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Sending DeleteTablet for 3 replicas of tablet a9d09cc09c974d94bf840bb037a46007
I20260806 18:39:45.621376 24569 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d09cc09c974d94bf840bb037a46007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:45 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:58624
I20260806 18:39:45.621416 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d09cc09c974d94bf840bb037a46007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:45 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:53640
I20260806 18:39:45.621606 24995 tablet_service.cc:1514] Processing DeleteTablet for tablet a9d09cc09c974d94bf840bb037a46007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:45 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:42548
I20260806 18:39:45.622220 25187 tablet_replica.cc:330] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: stopping tablet replica
I20260806 18:39:45.622116 24370 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:45.622603 24370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:45.622610 25187 raft_consensus.cc:2229] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:45.623046 25187 raft_consensus.cc:2258] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:45.623528 25186 tablet_replica.cc:330] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: stopping tablet replica
I20260806 18:39:45.623912 25186 raft_consensus.cc:2229] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:45.624259 25186 raft_consensus.cc:2258] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:45.625162 25187 ts_tablet_manager.cc:1905] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:45.625648 25186 ts_tablet_manager.cc:1905] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:45.628401 25187 ts_tablet_manager.cc:1918] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:45.628424 25186 ts_tablet_manager.cc:1918] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:45.628531 25186 log.cc:1196] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/a9d09cc09c974d94bf840bb037a46007
I20260806 18:39:45.628532 25187 log.cc:1196] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/a9d09cc09c974d94bf840bb037a46007
I20260806 18:39:45.628880 25186 ts_tablet_manager.cc:1939] T a9d09cc09c974d94bf840bb037a46007 P e5ec38edaf3b4370b815cb46d79beb46: Deleting consensus metadata
I20260806 18:39:45.628880 25187 ts_tablet_manager.cc:1939] T a9d09cc09c974d94bf840bb037a46007 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting consensus metadata
I20260806 18:39:45.628911 24569 tablet_service.cc:1467] Processing CreateTablet for tablet f36bd5a6007a4978b1161d49038f8489 (DEFAULT_TABLE table=test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.629776 24793 tablet_service.cc:1467] Processing CreateTablet for tablet f36bd5a6007a4978b1161d49038f8489 (DEFAULT_TABLE table=test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.630062 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36bd5a6007a4978b1161d49038f8489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.630452 25188 tablet_replica.cc:330] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: stopping tablet replica
I20260806 18:39:45.630874 25188 raft_consensus.cc:2229] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:45.631222 24357 catalog_manager.cc:4841] TS e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639): tablet a9d09cc09c974d94bf840bb037a46007 (table test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]) successfully deleted
I20260806 18:39:45.631399 25188 raft_consensus.cc:2258] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:45.631836 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36bd5a6007a4978b1161d49038f8489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.632822 24995 tablet_service.cc:1467] Processing CreateTablet for tablet f36bd5a6007a4978b1161d49038f8489 (DEFAULT_TABLE table=test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:45.633121 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36bd5a6007a4978b1161d49038f8489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.633298 25189 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Bootstrap starting.
I20260806 18:39:45.635070 25189 tablet_bootstrap.cc:654] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.635830 25190 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Bootstrap starting.
I20260806 18:39:45.633101 25188 ts_tablet_manager.cc:1905] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:45.636854 25190 tablet_bootstrap.cc:654] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.637470 24358 catalog_manager.cc:4841] TS 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095): tablet a9d09cc09c974d94bf840bb037a46007 (table test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]) successfully deleted
I20260806 18:39:45.638701 25192 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Bootstrap starting.
I20260806 18:39:45.639022 25189 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: No bootstrap required, opened a new log
I20260806 18:39:45.639120 25189 ts_tablet_manager.cc:1397] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 18:39:45.639209 25188 ts_tablet_manager.cc:1918] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:45.639412 25188 log.cc:1196] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/a9d09cc09c974d94bf840bb037a46007
I20260806 18:39:45.639628 25189 raft_consensus.cc:348] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.639760 25189 raft_consensus.cc:374] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.639797 25189 raft_consensus.cc:729] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.639976 25189 consensus_queue.cc:260] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.640028 25192 tablet_bootstrap.cc:654] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.641188 25190 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: No bootstrap required, opened a new log
I20260806 18:39:45.641292 25190 ts_tablet_manager.cc:1397] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 18:39:45.640815 25188 ts_tablet_manager.cc:1939] T a9d09cc09c974d94bf840bb037a46007 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting consensus metadata
I20260806 18:39:45.641866 25190 raft_consensus.cc:348] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.642004 25190 raft_consensus.cc:374] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.642043 25190 raft_consensus.cc:729] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd89aed56ce46cd88e1ce77c189be46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.642086 25189 ts_tablet_manager.cc:1428] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:45.642197 25190 consensus_queue.cc:260] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.642493 25190 ts_tablet_manager.cc:1428] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:45.643179 24357 catalog_manager.cc:4841] TS 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499): tablet a9d09cc09c974d94bf840bb037a46007 (table test-table [id=5452e756b85f4ccf8e5d5506d996fb9b]) successfully deleted
I20260806 18:39:45.643669 25192 tablet_bootstrap.cc:492] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: No bootstrap required, opened a new log
I20260806 18:39:45.643808 25192 ts_tablet_manager.cc:1397] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 18:39:45.644369 25192 raft_consensus.cc:348] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.644491 25192 raft_consensus.cc:374] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.644524 25192 raft_consensus.cc:729] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.644646 25192 consensus_queue.cc:260] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.645183 25192 ts_tablet_manager.cc:1428] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:45.766691 25170 raft_consensus.cc:482] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:45.766908 25170 raft_consensus.cc:504] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.768136 25170 leader_election.cc:288] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:45.774041 25155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.768775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:60275 (local address 127.12.177.129:45095)
0806 18:39:45.768918 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.768922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.769397 (+ 475us) server_negotiation.cc:407] Connection header received
0806 18:39:45.769693 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.769697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.769765 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.769843 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.770105 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.770609 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.772564 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.773233 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.773408 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.773472 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.773807 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.773898 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:39:45.774067 25199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.768440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45095 (local address 127.12.177.130:60275)
0806 18:39:45.769256 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.769277 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.769495 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.769851 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.769854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.769869 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.769991 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.769997 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.770739 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.770745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.772391 (+ 1646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.772406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.773510 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.773514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.773632 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.773665 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.773776 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.773860 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":468,"thread_start_us":98,"threads_started":1}
I20260806 18:39:45.774696 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36bd5a6007a4978b1161d49038f8489" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46" is_pre_election: true
I20260806 18:39:45.774897 24601 raft_consensus.cc:2454] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:45.775092 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.768605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:44751 (local address 127.12.177.131:36499)
0806 18:39:45.768751 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.768755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.769042 (+ 287us) server_negotiation.cc:407] Connection header received
0806 18:39:45.769288 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.769291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.769335 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.769451 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:39:45.769826 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.770652 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.773482 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.774130 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.774288 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.774346 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.774866 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.774956 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:45.775116 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.768438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:36499 (local address 127.12.177.130:44751)
0806 18:39:45.768935 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.768952 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.769135 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.769486 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.769489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.769508 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:39:45.769672 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.769680 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.770774 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.770778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.772391 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.772406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.774582 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.774586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.774703 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.774740 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.774876 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.774955 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":179,"thread_start_us":177,"threads_started":1}
I20260806 18:39:45.775401 24716 leader_election.cc:302] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd89aed56ce46cd88e1ce77c189be46, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:45.775741 25170 raft_consensus.cc:2781] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:45.775818 25170 raft_consensus.cc:482] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:45.775864 25170 raft_consensus.cc:3037] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.776022 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36bd5a6007a4978b1161d49038f8489" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" is_pre_election: true
I20260806 18:39:45.776275 24997 raft_consensus.cc:2454] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:45.777110 25170 raft_consensus.cc:504] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.777583 25170 leader_election.cc:288] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:45.778018 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36bd5a6007a4978b1161d49038f8489" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46"
I20260806 18:39:45.778154 24601 raft_consensus.cc:3037] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.779409 24601 raft_consensus.cc:2454] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:45.779771 24716 leader_election.cc:302] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd89aed56ce46cd88e1ce77c189be46, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:45.779855 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36bd5a6007a4978b1161d49038f8489" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
I20260806 18:39:45.780021 24997 raft_consensus.cc:3037] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:45.780031 25170 raft_consensus.cc:2781] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:45.780316 25170 raft_consensus.cc:686] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 LEADER]: Becoming Leader. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Running, Role: LEADER
I20260806 18:39:45.780604 25170 consensus_queue.cc:237] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.781265 24997 raft_consensus.cc:2454] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:45.783207 24368 catalog_manager.cc:5495] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130). New cstate: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } health_report { overall_health: UNKNOWN } } }
Aug 06 18:39:45 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041584, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.190@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:45.828442 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.819430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.12.177.190:40451)
0806 18:39:45.819731 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:45.819738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:45.819754 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:45.819921 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:45.819923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:45.819966 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:45.820049 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:45.820798 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.821430 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.822263 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.822509 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.822603 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.825127 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:45.825130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:45.825132 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:45.825153 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:45.826624 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:45.827099 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:45.827104 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:45.827106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:45.827185 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:45.827452 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:45.827457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:45.827458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:45.827649 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:45.827756 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:45.828064 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 18:39:45.828230 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":227,"thread_start_us":128,"threads_started":1}
I20260806 18:39:45.828442 25215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:45.819352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:40451 (local address 127.0.0.1:49002)
0806 18:39:45.819682 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:45.819696 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:45.819820 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:45.820113 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:45.820116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:45.820553 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:45.820653 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.820659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.821531 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.821534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.822132 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:45.822141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:45.822648 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:45.822651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:45.822721 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:45.823420 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:45.823432 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:45.824981 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:45.826737 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:45.826748 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:45.826755 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:45.826996 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:45.827282 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:45.827285 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:45.827287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:45.827367 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:45.827757 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:45.827766 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:45.827890 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 18:39:45.828004 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 18:39:45.828170 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":125,"threads_started":1}
I20260806 18:39:45.832955 24368 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:49002:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 18:39:45.833755 24368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:45.839596 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12c1eafd4743ada573614e1061e238 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=72fdc6321679477bb1cfead383d9dbcb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:45.839581 24569 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12c1eafd4743ada573614e1061e238 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=72fdc6321679477bb1cfead383d9dbcb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:45.839727 24995 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12c1eafd4743ada573614e1061e238 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=72fdc6321679477bb1cfead383d9dbcb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 18:39:45.840045 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a12c1eafd4743ada573614e1061e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.840066 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a12c1eafd4743ada573614e1061e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.840061 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a12c1eafd4743ada573614e1061e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:45.842764 25189 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: Bootstrap starting.
I20260806 18:39:45.843035 25190 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: Bootstrap starting.
I20260806 18:39:45.843297 25192 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: Bootstrap starting.
I20260806 18:39:45.843838 25189 tablet_bootstrap.cc:654] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.844099 25190 tablet_bootstrap.cc:654] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.844132 25192 tablet_bootstrap.cc:654] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:45.845677 25190 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: No bootstrap required, opened a new log
I20260806 18:39:45.845782 25190 ts_tablet_manager.cc:1397] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:45.845932 25189 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: No bootstrap required, opened a new log
I20260806 18:39:45.846045 25189 ts_tablet_manager.cc:1397] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:45.846338 25190 raft_consensus.cc:348] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.846479 25190 raft_consensus.cc:374] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.846525 25190 raft_consensus.cc:729] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd89aed56ce46cd88e1ce77c189be46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.846501 25189 raft_consensus.cc:348] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.846626 25189 raft_consensus.cc:374] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.846666 25189 raft_consensus.cc:729] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.846675 25190 consensus_queue.cc:260] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.846825 25189 consensus_queue.cc:260] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.846997 25190 ts_tablet_manager.cc:1428] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 18:39:45.847112 25189 ts_tablet_manager.cc:1428] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:45.847289 25171 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:45.847306 25170 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:45.847450 25170 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:45.847450 25171 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:45.848254 25192 tablet_bootstrap.cc:492] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: No bootstrap required, opened a new log
I20260806 18:39:45.848357 25192 ts_tablet_manager.cc:1397] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260806 18:39:45.848831 25192 raft_consensus.cc:348] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.848986 25192 raft_consensus.cc:374] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:45.849025 25192 raft_consensus.cc:729] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Initialized, Role: FOLLOWER
I20260806 18:39:45.849172 25192 consensus_queue.cc:260] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:45.849851 25192 ts_tablet_manager.cc:1428] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 18:39:45.849798 25150 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:45.849941 25150 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:46.029549 25170 raft_consensus.cc:482] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:46.029742 25170 raft_consensus.cc:504] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.030293 25170 leader_election.cc:288] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:46.030920 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a12c1eafd4743ada573614e1061e238" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46" is_pre_election: true
I20260806 18:39:46.030920 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a12c1eafd4743ada573614e1061e238" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" is_pre_election: true
I20260806 18:39:46.031097 24997 raft_consensus.cc:2454] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:46.031097 24601 raft_consensus.cc:2454] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:46.031468 24716 leader_election.cc:302] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, 6fd89aed56ce46cd88e1ce77c189be46, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:46.031659 25170 raft_consensus.cc:2781] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:46.031723 25170 raft_consensus.cc:482] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:46.031769 25170 raft_consensus.cc:3037] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.033411 25170 raft_consensus.cc:504] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.033779 25170 leader_election.cc:288] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:46.034194 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a12c1eafd4743ada573614e1061e238" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46"
I20260806 18:39:46.034222 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a12c1eafd4743ada573614e1061e238" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
I20260806 18:39:46.034372 24601 raft_consensus.cc:3037] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.034372 24997 raft_consensus.cc:3037] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.035657 24997 raft_consensus.cc:2454] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:46.035657 24601 raft_consensus.cc:2454] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:46.035960 24715 leader_election.cc:302] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:46.036162 25170 raft_consensus.cc:2781] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:46.036273 25170 raft_consensus.cc:686] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 LEADER]: Becoming Leader. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Running, Role: LEADER
I20260806 18:39:46.036466 25170 consensus_queue.cc:237] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.037196 25202 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: TxnStatusTablet state changed. Reason: New leader e5ec38edaf3b4370b815cb46d79beb46. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.037320 25202 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:46.037662 25228 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 18:39:46.037904 25228 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 18:39:46.038425 24374 catalog_manager.cc:5495] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130). New cstate: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260806 18:39:46.093672 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.088758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35784 (local address 127.12.177.130:34639)
0806 18:39:46.089170 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.089177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.089189 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:39:46.089265 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.089267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.089334 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.089521 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.089796 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.090360 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.091300 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.091544 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.091665 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.092033 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.093023 (+ 990us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.093191 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.093307 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.093430 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":173,"threads_started":1}
I20260806 18:39:46.093659 25215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.088613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:34639 (local address 127.0.0.1:35784)
0806 18:39:46.088805 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:46.088826 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:46.088940 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:46.089535 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:46.089539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:46.089548 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:46.089673 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.089678 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.090482 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.090487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.091156 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.091166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.091676 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.091680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.091794 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.091850 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.093162 (+ 1312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.093184 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:39:46.093318 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 18:39:46.093465 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 18:39:46.097530 24601 raft_consensus.cc:1261] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.097700 24997 raft_consensus.cc:1261] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.098323 25202 consensus_queue.cc:1035] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.098563 25170 consensus_queue.cc:1035] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.100569 25150 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: TxnStatusTablet state changed. Reason: New leader e5ec38edaf3b4370b815cb46d79beb46. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.100708 25150 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:46.101938 25171 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: TxnStatusTablet state changed. Reason: New leader e5ec38edaf3b4370b815cb46d79beb46. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.102079 25171 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:46.103621 25202 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.103813 25202 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:46.104169 25202 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.104279 25202 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P e5ec38edaf3b4370b815cb46d79beb46: This TxnStatusTablet replica's current role is: LEADER
I20260806 18:39:46.104864 25171 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.105000 25171 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 6fd89aed56ce46cd88e1ce77c189be46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:46.105769 25150 tablet_replica.cc:439] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } } }
I20260806 18:39:46.105903 25150 tablet_replica.cc:442] T 9a12c1eafd4743ada573614e1061e238 P 01602db7b3ef42e0b2a6bf9d65cab682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 18:39:46.106873 25167 mvcc.cc:205] Tried to move back new op lower bound from 7315626336649367552 to 7315626336406925312. Current Snapshot: MvccSnapshot[applied={T|T < 7315626336649367552 or (T in {7315626336649367552})}]
I20260806 18:39:46.116008 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.111861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.12.177.130:34639)
0806 18:39:46.111996 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.112000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.112055 (+ 55us) server_negotiation.cc:407] Connection header received
0806 18:39:46.112261 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.112263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.112325 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.112398 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.112750 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.113267 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.114651 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.114921 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.115037 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.115361 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.115456 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.115523 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.115725 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.115795 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 18:39:46.129441 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.125312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:55245 (local address 127.12.177.130:34639)
0806 18:39:46.125481 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.125486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.125745 (+ 259us) server_negotiation.cc:407] Connection header received
0806 18:39:46.125916 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.125919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.125968 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.126050 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.126346 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.126854 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.128144 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.128386 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.128470 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.128897 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.128989 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.129054 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.129188 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.129240 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:39:46.129686 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.125256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:34639 (local address 127.12.177.130:55245)
0806 18:39:46.125639 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:46.125656 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:46.125780 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:46.126082 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:46.126084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:46.126092 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:46.126220 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.126226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.126973 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.126976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.128008 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.128019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.128519 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.128523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.128628 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.128693 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.129080 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.129087 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:39:46.129158 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 18:39:46.129257 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":3,"thread_start_us":159,"threads_started":1}
I20260806 18:39:46.137913 24997 raft_consensus.cc:1261] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.137913 24601 raft_consensus.cc:1261] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.138326 25246 consensus_queue.cc:1035] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.138577 25170 consensus_queue.cc:1035] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.191298 24368 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.191532 24368 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.194453 24368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Sending DeleteTablet for 3 replicas of tablet f36bd5a6007a4978b1161d49038f8489
I20260806 18:39:46.195199 24569 tablet_service.cc:1514] Processing DeleteTablet for tablet f36bd5a6007a4978b1161d49038f8489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:58624
I20260806 18:39:46.195597 24995 tablet_service.cc:1514] Processing DeleteTablet for tablet f36bd5a6007a4978b1161d49038f8489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:42548
I20260806 18:39:46.195935 25251 tablet_replica.cc:330] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: stopping tablet replica
I20260806 18:39:46.196098 25251 raft_consensus.cc:2229] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.196236 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet f36bd5a6007a4978b1161d49038f8489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:53640
I20260806 18:39:46.196237 25251 raft_consensus.cc:2258] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.198634 25256 tablet_replica.cc:330] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: stopping tablet replica
I20260806 18:39:46.198701 25251 ts_tablet_manager.cc:1905] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.198797 25256 raft_consensus.cc:2229] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:46.199213 25256 raft_consensus.cc:2258] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.199469 25255 tablet_replica.cc:330] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: stopping tablet replica
I20260806 18:39:46.199613 25255 raft_consensus.cc:2229] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.199741 25255 raft_consensus.cc:2258] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.201651 25256 ts_tablet_manager.cc:1905] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.203677 25251 ts_tablet_manager.cc:1918] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:46.203835 25251 log.cc:1196] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/f36bd5a6007a4978b1161d49038f8489
I20260806 18:39:46.204113 25251 ts_tablet_manager.cc:1939] T f36bd5a6007a4978b1161d49038f8489 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting consensus metadata
I20260806 18:39:46.205000 25256 ts_tablet_manager.cc:1918] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:46.205022 24358 catalog_manager.cc:4841] TS 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095): tablet f36bd5a6007a4978b1161d49038f8489 (table test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]) successfully deleted
I20260806 18:39:46.205096 25256 log.cc:1196] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/f36bd5a6007a4978b1161d49038f8489
I20260806 18:39:46.205420 25256 ts_tablet_manager.cc:1939] T f36bd5a6007a4978b1161d49038f8489 P e5ec38edaf3b4370b815cb46d79beb46: Deleting consensus metadata
I20260806 18:39:46.206326 24357 catalog_manager.cc:4841] TS e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639): tablet f36bd5a6007a4978b1161d49038f8489 (table test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]) successfully deleted
I20260806 18:39:46.206694 25255 ts_tablet_manager.cc:1905] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.211376 25255 ts_tablet_manager.cc:1918] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:46.211504 25255 log.cc:1196] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/f36bd5a6007a4978b1161d49038f8489
I20260806 18:39:46.211942 25255 ts_tablet_manager.cc:1939] T f36bd5a6007a4978b1161d49038f8489 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting consensus metadata
I20260806 18:39:46.213506 24357 catalog_manager.cc:4841] TS 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499): tablet f36bd5a6007a4978b1161d49038f8489 (table test-table [id=3b41ab0f9fb04f04a8e6b2a8a702ef78]) successfully deleted
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 18:39:46.232865 25218 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:46.224624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49018 (local address 127.12.177.190:40451)
0806 18:39:46.224872 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.224876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.225004 (+ 128us) server_negotiation.cc:407] Connection header received
0806 18:39:46.225173 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.225175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.225218 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.225295 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:46.226266 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.226845 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.228178 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.228434 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.228529 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.232696 (+ 4167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49018: BlockingRecv error: recv got EOF from 127.0.0.1:49018 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM
I20260806 18:39:46.246361 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.234716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.12.177.190:40451)
0806 18:39:46.235024 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.235028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.235045 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:39:46.235239 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.235243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.235301 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.235385 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:46.236147 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.236998 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.238180 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.238519 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.238663 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.241580 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:46.241586 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:46.241589 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:46.241633 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:46.243580 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:46.244135 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:46.244139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:46.244141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:46.244248 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:46.244589 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:46.244592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:46.244594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:46.244981 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:46.245143 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.245582 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.245749 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260806 18:39:46.250574 24368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:39:46.251173 24368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:46.257258 24569 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (DEFAULT_TABLE table=test-table [id=c52028b5c6254cc782dd94ef2129e252]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.257691 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0a48a7b4a45e8aac76c4ad8277e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.261057 25190 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Bootstrap starting.
I20260806 18:39:46.261169 24793 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (DEFAULT_TABLE table=test-table [id=c52028b5c6254cc782dd94ef2129e252]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.261636 24995 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (DEFAULT_TABLE table=test-table [id=c52028b5c6254cc782dd94ef2129e252]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.261957 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0a48a7b4a45e8aac76c4ad8277e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.262375 25190 tablet_bootstrap.cc:654] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.263900 25190 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: No bootstrap required, opened a new log
I20260806 18:39:46.264027 25190 ts_tablet_manager.cc:1397] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:46.264591 25192 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Bootstrap starting.
I20260806 18:39:46.264555 25190 raft_consensus.cc:348] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.264684 25190 raft_consensus.cc:374] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.264716 25190 raft_consensus.cc:729] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd89aed56ce46cd88e1ce77c189be46, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.265079 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0a48a7b4a45e8aac76c4ad8277e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.265416 25190 consensus_queue.cc:260] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.265595 25192 tablet_bootstrap.cc:654] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.265786 25190 ts_tablet_manager.cc:1428] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 18:39:46.266754 25192 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: No bootstrap required, opened a new log
I20260806 18:39:46.266883 25192 ts_tablet_manager.cc:1397] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:46.267292 25192 raft_consensus.cc:348] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.267416 25192 raft_consensus.cc:374] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.267459 25192 raft_consensus.cc:729] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.267616 25192 consensus_queue.cc:260] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.267915 25192 ts_tablet_manager.cc:1428] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:46.272850 25189 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Bootstrap starting.
I20260806 18:39:46.273914 25189 tablet_bootstrap.cc:654] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.275743 25189 tablet_bootstrap.cc:492] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: No bootstrap required, opened a new log
I20260806 18:39:46.275883 25189 ts_tablet_manager.cc:1397] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:46.276479 25189 raft_consensus.cc:348] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.276651 25189 raft_consensus.cc:374] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.276700 25189 raft_consensus.cc:729] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.276865 25189 consensus_queue.cc:260] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.277220 25189 ts_tablet_manager.cc:1428] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:46.326442 25170 raft_consensus.cc:482] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:46.326607 25170 raft_consensus.cc:504] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.327172 25170 leader_election.cc:288] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:46.327736 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0a48a7b4a45e8aac76c4ad8277e05" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" is_pre_election: true
I20260806 18:39:46.327936 24997 raft_consensus.cc:2454] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:46.327989 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0a48a7b4a45e8aac76c4ad8277e05" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46" is_pre_election: true
I20260806 18:39:46.328153 24601 raft_consensus.cc:2454] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 0.
I20260806 18:39:46.328310 24715 leader_election.cc:302] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:46.328500 25170 raft_consensus.cc:2781] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:46.328554 25170 raft_consensus.cc:482] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:46.328604 25170 raft_consensus.cc:3037] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.329931 25170 raft_consensus.cc:504] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.330376 25170 leader_election.cc:288] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499)
I20260806 18:39:46.330796 24997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0a48a7b4a45e8aac76c4ad8277e05" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01602db7b3ef42e0b2a6bf9d65cab682"
I20260806 18:39:46.330780 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0a48a7b4a45e8aac76c4ad8277e05" candidate_uuid: "e5ec38edaf3b4370b815cb46d79beb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46"
I20260806 18:39:46.330953 24601 raft_consensus.cc:3037] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.330955 24997 raft_consensus.cc:3037] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.332054 24997 raft_consensus.cc:2454] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:46.332242 24601 raft_consensus.cc:2454] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ec38edaf3b4370b815cb46d79beb46 in term 1.
I20260806 18:39:46.332471 24715 leader_election.cc:302] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:46.332705 25170 raft_consensus.cc:2781] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:46.332816 25170 raft_consensus.cc:686] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 LEADER]: Becoming Leader. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Running, Role: LEADER
I20260806 18:39:46.333056 25170 consensus_queue.cc:237] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.335152 24368 catalog_manager.cc:5495] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130). New cstate: current_term: 1 leader_uuid: "e5ec38edaf3b4370b815cb46d79beb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260806 18:39:46.352768 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.348960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.12.177.130:34639)
0806 18:39:46.349094 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.349098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.349112 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:46.349249 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.349251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.349296 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.349412 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.349700 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.350271 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.351470 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.351709 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.351796 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.352110 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.352198 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.352260 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.352483 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.352590 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 18:39:46.355372 24997 raft_consensus.cc:1261] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.355372 24601 raft_consensus.cc:1261] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Refusing update from remote peer e5ec38edaf3b4370b815cb46d79beb46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.356096 25170 consensus_queue.cc:1035] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.356328 25249 consensus_queue.cc:1035] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.364778 24368 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.364965 24368 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.367894 24368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Sending DeleteTablet for 3 replicas of tablet e9b0a48a7b4a45e8aac76c4ad8277e05
I20260806 18:39:46.368609 24995 tablet_service.cc:1514] Processing DeleteTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:42548
I20260806 18:39:46.368899 25255 tablet_replica.cc:330] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: stopping tablet replica
I20260806 18:39:46.369056 25255 raft_consensus.cc:2229] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.369225 25255 raft_consensus.cc:2258] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.369498 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:53640
I20260806 18:39:46.369711 25256 tablet_replica.cc:330] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: stopping tablet replica
I20260806 18:39:46.369887 25256 raft_consensus.cc:2229] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:46.370076 24995 tablet_service.cc:1514] Processing DeleteTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:42548
I20260806 18:39:46.370126 25256 raft_consensus.cc:2258] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.370463 24569 tablet_service.cc:1514] Processing DeleteTablet for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:58624
I20260806 18:39:46.370664 25251 tablet_replica.cc:330] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: stopping tablet replica
I20260806 18:39:46.370796 25251 raft_consensus.cc:2229] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.370693 24368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 18:39:46.370955 25251 raft_consensus.cc:2258] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 18:39:46.371218 24368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:39:46.372443 25256 ts_tablet_manager.cc:1905] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.375521 25256 ts_tablet_manager.cc:1918] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:46.375639 25256 log.cc:1196] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/e9b0a48a7b4a45e8aac76c4ad8277e05
I20260806 18:39:46.375926 25256 ts_tablet_manager.cc:1939] T e9b0a48a7b4a45e8aac76c4ad8277e05 P e5ec38edaf3b4370b815cb46d79beb46: Deleting consensus metadata
I20260806 18:39:46.376530 24569 tablet_service.cc:1467] Processing CreateTablet for tablet 9a087b278e6144b7a108c53e1133a62e (DEFAULT_TABLE table=test-table [id=519659f579464f38bb60095370f7c341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.376724 24995 tablet_service.cc:1467] Processing CreateTablet for tablet 9a087b278e6144b7a108c53e1133a62e (DEFAULT_TABLE table=test-table [id=519659f579464f38bb60095370f7c341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.376842 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a087b278e6144b7a108c53e1133a62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.376984 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a087b278e6144b7a108c53e1133a62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.376996 25251 ts_tablet_manager.cc:1905] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.379482 25192 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Bootstrap starting.
I20260806 18:39:46.379906 25255 ts_tablet_manager.cc:1905] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.380091 24357 catalog_manager.cc:4841] TS e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639): tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (table test-table [id=c52028b5c6254cc782dd94ef2129e252]) successfully deleted
I20260806 18:39:46.380424 25192 tablet_bootstrap.cc:654] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.381347 25190 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: Bootstrap starting.
I20260806 18:39:46.382401 25190 tablet_bootstrap.cc:654] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.382617 25255 ts_tablet_manager.cc:1918] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:46.382709 25255 log.cc:1196] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/e9b0a48a7b4a45e8aac76c4ad8277e05
I20260806 18:39:46.382980 25255 ts_tablet_manager.cc:1939] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting consensus metadata
I20260806 18:39:46.383558 25192 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: No bootstrap required, opened a new log
I20260806 18:39:46.383653 25192 ts_tablet_manager.cc:1397] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 18:39:46.384089 25192 raft_consensus.cc:348] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.384100 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 9a087b278e6144b7a108c53e1133a62e (DEFAULT_TABLE table=test-table [id=519659f579464f38bb60095370f7c341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:39:46.384227 25192 raft_consensus.cc:374] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.384274 25192 raft_consensus.cc:729] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.384397 25192 consensus_queue.cc:260] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.384454 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a087b278e6144b7a108c53e1133a62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:46.384671 25192 ts_tablet_manager.cc:1428] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 18:39:46.385877 25190 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: No bootstrap required, opened a new log
I20260806 18:39:46.386001 25190 ts_tablet_manager.cc:1397] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260806 18:39:46.386436 25190 raft_consensus.cc:348] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.386561 25190 raft_consensus.cc:374] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.386601 25190 raft_consensus.cc:729] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd89aed56ce46cd88e1ce77c189be46, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.386746 25190 consensus_queue.cc:260] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.387061 25190 ts_tablet_manager.cc:1428] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260806 18:39:46.387130 25189 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Bootstrap starting.
I20260806 18:39:46.387826 24357 catalog_manager.cc:4841] TS 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499): tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (table test-table [id=c52028b5c6254cc782dd94ef2129e252]) successfully deleted
I20260806 18:39:46.387961 25189 tablet_bootstrap.cc:654] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:46.389199 25189 tablet_bootstrap.cc:492] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: No bootstrap required, opened a new log
I20260806 18:39:46.389293 25189 ts_tablet_manager.cc:1397] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 18:39:46.389863 25189 raft_consensus.cc:348] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.389988 25189 raft_consensus.cc:374] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:46.390033 25189 raft_consensus.cc:729] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ec38edaf3b4370b815cb46d79beb46, State: Initialized, Role: FOLLOWER
I20260806 18:39:46.390166 25189 consensus_queue.cc:260] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.390455 25189 ts_tablet_manager.cc:1428] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 18:39:46.391079 25251 ts_tablet_manager.cc:1918] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:39:46.391184 25251 log.cc:1196] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/e9b0a48a7b4a45e8aac76c4ad8277e05
I20260806 18:39:46.391517 25251 ts_tablet_manager.cc:1939] T e9b0a48a7b4a45e8aac76c4ad8277e05 P 6fd89aed56ce46cd88e1ce77c189be46: Deleting consensus metadata
I20260806 18:39:46.392508 24358 catalog_manager.cc:4841] TS 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095): tablet e9b0a48a7b4a45e8aac76c4ad8277e05 (table test-table [id=c52028b5c6254cc782dd94ef2129e252]) successfully deleted
W20260806 18:39:46.393461 24357 catalog_manager.cc:4808] TS 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499): delete failed for tablet e9b0a48a7b4a45e8aac76c4ad8277e05 because the tablet was not found. No further retry: Not found: Tablet not found: e9b0a48a7b4a45e8aac76c4ad8277e05
I20260806 18:39:46.494038 25150 raft_consensus.cc:482] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:39:46.494282 25150 raft_consensus.cc:504] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.494880 25150 leader_election.cc:288] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639)
I20260806 18:39:46.495374 24820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a087b278e6144b7a108c53e1133a62e" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ec38edaf3b4370b815cb46d79beb46" is_pre_election: true
I20260806 18:39:46.495376 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a087b278e6144b7a108c53e1133a62e" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46" is_pre_election: true
I20260806 18:39:46.495537 24820 raft_consensus.cc:2454] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 0.
I20260806 18:39:46.495558 24601 raft_consensus.cc:2454] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 0.
I20260806 18:39:46.495864 24922 leader_election.cc:302] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, e5ec38edaf3b4370b815cb46d79beb46; no voters:
I20260806 18:39:46.496052 25150 raft_consensus.cc:2781] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:39:46.496107 25150 raft_consensus.cc:482] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:39:46.496161 25150 raft_consensus.cc:3037] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.497223 25150 raft_consensus.cc:504] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.497640 25150 leader_election.cc:288] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095), e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639)
I20260806 18:39:46.498085 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a087b278e6144b7a108c53e1133a62e" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd89aed56ce46cd88e1ce77c189be46"
I20260806 18:39:46.498148 24820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a087b278e6144b7a108c53e1133a62e" candidate_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ec38edaf3b4370b815cb46d79beb46"
I20260806 18:39:46.498219 24601 raft_consensus.cc:3037] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.498322 24820 raft_consensus.cc:3037] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:46.499419 24601 raft_consensus.cc:2454] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 1.
I20260806 18:39:46.499575 24820 raft_consensus.cc:2454] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01602db7b3ef42e0b2a6bf9d65cab682 in term 1.
I20260806 18:39:46.499805 24923 leader_election.cc:302] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01602db7b3ef42e0b2a6bf9d65cab682, 6fd89aed56ce46cd88e1ce77c189be46; no voters:
I20260806 18:39:46.499994 25150 raft_consensus.cc:2781] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:46.500166 25150 raft_consensus.cc:686] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 LEADER]: Becoming Leader. State: Replica: 01602db7b3ef42e0b2a6bf9d65cab682, State: Running, Role: LEADER
I20260806 18:39:46.500345 25150 consensus_queue.cc:237] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } }
I20260806 18:39:46.502140 24368 catalog_manager.cc:5495] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01602db7b3ef42e0b2a6bf9d65cab682" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260806 18:39:46.524397 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.521216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37536 (local address 127.12.177.131:36499)
0806 18:39:46.521504 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.521526 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.521541 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:46.521584 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.521586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.521627 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.521705 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.522023 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.522554 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.523359 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.523584 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.523669 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.523900 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.523983 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.524039 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.524116 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.524161 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":133,"threads_started":1}
I20260806 18:39:46.536197 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.532342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:53673 (local address 127.12.177.130:34639)
0806 18:39:46.532532 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.532539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.532794 (+ 255us) server_negotiation.cc:407] Connection header received
0806 18:39:46.532889 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.532891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.532959 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.533063 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.533265 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.533947 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.534900 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.535141 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.535340 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.535708 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.535802 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.535869 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.536013 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.536071 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 18:39:46.536226 25302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.532212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:34639 (local address 127.12.177.131:53673)
0806 18:39:46.532681 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:46.532695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:46.532805 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:46.533080 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:46.533082 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:46.533089 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:46.533191 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.533195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.534059 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.534062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.534687 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.534697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.535361 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.535364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.535440 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.535499 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.535891 (+ 392us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.535898 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:39:46.536008 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 18:39:46.536101 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":165,"threads_started":1}
I20260806 18:39:46.542919 24820 raft_consensus.cc:1261] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Refusing update from remote peer 01602db7b3ef42e0b2a6bf9d65cab682: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.542953 24601 raft_consensus.cc:1261] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Refusing update from remote peer 01602db7b3ef42e0b2a6bf9d65cab682: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:39:46.543359 25292 consensus_queue.cc:1035] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd89aed56ce46cd88e1ce77c189be46" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.543537 25150 consensus_queue.cc:1035] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ec38edaf3b4370b815cb46d79beb46" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:39:46.562633 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.559369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:43425 (local address 127.12.177.131:36499)
0806 18:39:46.559510 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:46.559515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:46.559528 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:39:46.559573 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:46.559580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:46.559622 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:46.559705 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:39:46.559951 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.560488 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.561333 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.561611 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.561730 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.561997 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.562114 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.562247 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:46.562372 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 18:39:46.562449 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:39:46.562633 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.559190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:36499 (local address 127.12.177.130:43425)
0806 18:39:46.559323 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:46.559339 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:46.559427 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:46.559719 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:46.559722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:46.559729 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 18:39:46.559836 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.559842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.560608 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.560611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.561208 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:46.561216 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:46.561733 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:46.561736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:46.561826 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:46.561862 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 18:39:46.562258 (+ 396us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 18:39:46.562267 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 18:39:46.562343 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 18:39:46.562429 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 18:39:46.585568 24370 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.585731 24370 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:39:46.587946 24370 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3921bb58da9a40b2b8093cbd4e0e7d44: Sending DeleteTablet for 3 replicas of tablet 9a087b278e6144b7a108c53e1133a62e
I20260806 18:39:46.588617 24569 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a087b278e6144b7a108c53e1133a62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:58624
I20260806 18:39:46.588688 24995 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a087b278e6144b7a108c53e1133a62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:42548
I20260806 18:39:46.588845 25251 tablet_replica.cc:330] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46: stopping tablet replica
I20260806 18:39:46.588997 25251 raft_consensus.cc:2229] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.589061 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a087b278e6144b7a108c53e1133a62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:39:46 UTC) from {username='oryx', principal='oryx/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:53640
I20260806 18:39:46.589138 25251 raft_consensus.cc:2258] T 9a087b278e6144b7a108c53e1133a62e P 6fd89aed56ce46cd88e1ce77c189be46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.589282 25256 tablet_replica.cc:330] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: stopping tablet replica
I20260806 18:39:46.589354 25255 tablet_replica.cc:330] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: stopping tablet replica
I20260806 18:39:46.589438 25256 raft_consensus.cc:2229] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:39:46.589479 25255 raft_consensus.cc:2229] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:39:46.589582 25256 raft_consensus.cc:2258] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.589684 25255 raft_consensus.cc:2258] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:39:46.590027 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 24488
I20260806 18:39:46.590421 25256 ts_tablet_manager.cc:1905] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.591132 25255 ts_tablet_manager.cc:1905] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:39:46.594630 25256 ts_tablet_manager.cc:1918] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:46.594774 25256 log.cc:1196] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/9a087b278e6144b7a108c53e1133a62e
I20260806 18:39:46.595077 25256 ts_tablet_manager.cc:1939] T 9a087b278e6144b7a108c53e1133a62e P e5ec38edaf3b4370b815cb46d79beb46: Deleting consensus metadata
I20260806 18:39:46.595052 25255 ts_tablet_manager.cc:1918] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 18:39:46.595156 25255 log.cc:1196] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/9a087b278e6144b7a108c53e1133a62e
I20260806 18:39:46.595507 25255 ts_tablet_manager.cc:1939] T 9a087b278e6144b7a108c53e1133a62e P 01602db7b3ef42e0b2a6bf9d65cab682: Deleting consensus metadata
I20260806 18:39:46.595985 24357 catalog_manager.cc:4841] TS e5ec38edaf3b4370b815cb46d79beb46 (127.12.177.130:34639): tablet 9a087b278e6144b7a108c53e1133a62e (table test-table [id=519659f579464f38bb60095370f7c341]) successfully deleted
I20260806 18:39:46.596339 24357 catalog_manager.cc:4841] TS 01602db7b3ef42e0b2a6bf9d65cab682 (127.12.177.131:36499): tablet 9a087b278e6144b7a108c53e1133a62e (table test-table [id=519659f579464f38bb60095370f7c341]) successfully deleted
W20260806 18:39:46.606849 24358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:45095 (error 108)
I20260806 18:39:46.606966 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 24688
I20260806 18:39:46.616503 25308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:46.616009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45095 (local address 127.0.0.1:52462)
0806 18:39:46.616312 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:46.616397 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
W20260806 18:39:46.616675 24358 catalog_manager.cc:4584] TS 6fd89aed56ce46cd88e1ce77c189be46 (127.12.177.129:45095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9a087b278e6144b7a108c53e1133a62e: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45095: connect: Connection refused (error 111)
I20260806 18:39:46.624894 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 24900
I20260806 18:39:46.645500 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 24334
2026-08-06T18:39:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4225 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[25312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[25312](info): set up 2 sockets
Aug 06 18:39:46 dist-test-slave-j2vl krb5kdc[25312](info): commencing operation
krb5kdc: starting...
W20260806 18:39:47.962668 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:48 dist-test-slave-j2vl krb5kdc[25312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:48.114359 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37431
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:37289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:48.243136 25328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:48.243546 25328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:48.243636 25328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:48.248072 25328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:48.248229 25328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:48.248267 25328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:48.248299 25328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:48.248339 25328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:48.254951 25328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:37289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:48.256388 25328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:48.257652 25328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:48.268201 25345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:48.268229 25339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:48.268546 25328 server_base.cc:1034] running on GCE node
W20260806 18:39:48.268229 25340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:48.269560 25328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:48.270951 25328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:48.272208 25328 hybrid_clock.cc:648] HybridClock initialized: now 1786041588272189 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T18:39:48Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1624 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:39:48 dist-test-slave-j2vl krb5kdc[25352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:39:48 dist-test-slave-j2vl krb5kdc[25352](info): set up 2 sockets
Aug 06 18:39:48 dist-test-slave-j2vl krb5kdc[25352](info): commencing operation
krb5kdc: starting...
W20260806 18:39:49.557899 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:39:49 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:39:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:39:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:39:49.706010 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46135
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:46135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:49.830575 25368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:49.830943 25368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:49.831036 25368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:49.835322 25368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:49.835443 25368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:49.835480 25368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:49.835536 25368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:49.835594 25368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:49.841528 25368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:46135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:49.842875 25368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:49.843979 25368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:49.853626 25374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:49.853626 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:49.853708 25368 server_base.cc:1034] running on GCE node
W20260806 18:39:49.854018 25375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:49.854737 25368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:49.856046 25368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:49.857262 25368 hybrid_clock.cc:648] HybridClock initialized: now 1786041589857244 us; error 35 us; skew 500 ppm
Aug 06 18:39:49 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041589, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:49.871769 25368 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:49.873040 25368 webserver.cc:460] Webserver started at http://127.12.177.190:38063/ using document root <none> and password file <none>
I20260806 18:39:49.873803 25368 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:49.873916 25368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:49.874197 25368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:49.876799 25368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "61b483193f2144bbb3a23280a2c4c63e"
format_stamp: "Formatted at 2026-08-06 18:39:49 on dist-test-slave-j2vl"
server_key: "d92848d4f3eccb38518e80229aa024cc"
server_key_iv: "88703bf5bc98ab281b7e6da2c8bfab9f"
server_key_version: "encryptionkey@0"
I20260806 18:39:49.877589 25368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "61b483193f2144bbb3a23280a2c4c63e"
format_stamp: "Formatted at 2026-08-06 18:39:49 on dist-test-slave-j2vl"
server_key: "d92848d4f3eccb38518e80229aa024cc"
server_key_iv: "88703bf5bc98ab281b7e6da2c8bfab9f"
server_key_version: "encryptionkey@0"
I20260806 18:39:49.881767 25368 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:49.884637 25392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:49.886154 25368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:49.886323 25368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "61b483193f2144bbb3a23280a2c4c63e"
format_stamp: "Formatted at 2026-08-06 18:39:49 on dist-test-slave-j2vl"
server_key: "d92848d4f3eccb38518e80229aa024cc"
server_key_iv: "88703bf5bc98ab281b7e6da2c8bfab9f"
server_key_version: "encryptionkey@0"
I20260806 18:39:49.886461 25368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:49.912947 25368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:49.916637 25368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:49.916909 25368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:49.925530 25368 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:46135
I20260806 18:39:49.925565 25466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:46135 every 8 connection(s)
I20260806 18:39:49.926652 25368 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:49.929910 25467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:39:49.935796 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 25368
I20260806 18:39:49.935986 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:39:49.936458 12998 external_mini_cluster.cc:1428] Setting key f30262fed9c6e1127ba4aa08b08a0ee6
I20260806 18:39:49.937103 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Bootstrap starting.
I20260806 18:39:49.940325 25467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Neither blocks nor log segments found. Creating new log.
I20260806 18:39:49.941305 25467 log.cc:824] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:49.943791 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: No bootstrap required, opened a new log
Aug 06 18:39:49 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:49.948858 25467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:49.949215 25467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:39:49.949298 25467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b483193f2144bbb3a23280a2c4c63e, State: Initialized, Role: FOLLOWER
I20260806 18:39:49.949867 25467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:49.950021 25467 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:49.950116 25467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:49.950245 25467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:39:49.951387 25467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:49.951851 25467 leader_election.cc:302] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b483193f2144bbb3a23280a2c4c63e; no voters:
I20260806 18:39:49.952296 25467 leader_election.cc:288] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:39:49.952495 25475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:39:49.952785 25475 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 LEADER]: Becoming Leader. State: Replica: 61b483193f2144bbb3a23280a2c4c63e, State: Running, Role: LEADER
I20260806 18:39:49.953320 25475 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:49.953883 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:49.938489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48672 (local address 127.12.177.190:46135)
0806 18:39:49.939089 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:49.939107 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:49.939150 (+ 43us) server_negotiation.cc:407] Connection header received
0806 18:39:49.939959 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:49.939979 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:49.940367 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:49.940826 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:49.941828 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:49.942874 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:49.943797 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:49.944397 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:49.944585 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:49.947855 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:49.947862 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:49.947880 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:49.947917 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:49.950259 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:49.950804 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:49.950810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:49.950818 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:49.950958 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:49.951276 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:49.951279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:49.951281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:49.951830 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:49.952074 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:49.952419 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 18:39:49.952811 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":186,"threads_started":1}
I20260806 18:39:49.953961 25467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:49.955423 25477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61b483193f2144bbb3a23280a2c4c63e. Latest consensus state: current_term: 1 leader_uuid: "61b483193f2144bbb3a23280a2c4c63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } } }
I20260806 18:39:49.955562 25477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:49.955965 25476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61b483193f2144bbb3a23280a2c4c63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } } }
I20260806 18:39:49.956060 25476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:49.956358 25489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:49.959841 25489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:49.967507 25489 catalog_manager.cc:1347] Generated new cluster ID: 4fe48df0bfbb41f7884b9d841c2e8012
I20260806 18:39:49.967613 25489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:49.972995 25489 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:39:49.974148 25489 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:49.986394 25489 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Generated new TSK 0
I20260806 18:39:49.987579 25489 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:39:50.033998 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:50.162988 25505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:50.163334 25505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:50.163419 25505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:50.167733 25505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:50.167855 25505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:50.167989 25505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:50.174293 25505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:50.175575 25505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:50.176692 25505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:50.187781 25512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:50.188006 25516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:50.188017 25511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:50.188472 25505 server_base.cc:1034] running on GCE node
I20260806 18:39:50.189143 25505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:50.190131 25505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:50.191392 25505 hybrid_clock.cc:648] HybridClock initialized: now 1786041590191364 us; error 43 us; skew 500 ppm
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:50.194773 25505 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:39:50.195905 25505 webserver.cc:460] Webserver started at http://127.12.177.129:37645/ using document root <none> and password file <none>
I20260806 18:39:50.196702 25505 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:50.196871 25505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:50.197162 25505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:50.200109 25505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "3f993fcc4bcc4cd4aecd5f6a08dee9b3"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "2ac961d3ff56af8948bc8a9bd920ad96"
server_key_iv: "4f2148cb26352e68f4ae98fecad6b3ef"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.200845 25505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "3f993fcc4bcc4cd4aecd5f6a08dee9b3"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "2ac961d3ff56af8948bc8a9bd920ad96"
server_key_iv: "4f2148cb26352e68f4ae98fecad6b3ef"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.205670 25505 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260806 18:39:50.208535 25528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.209978 25505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:50.210145 25505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "3f993fcc4bcc4cd4aecd5f6a08dee9b3"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "2ac961d3ff56af8948bc8a9bd920ad96"
server_key_iv: "4f2148cb26352e68f4ae98fecad6b3ef"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.210285 25505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:50.228348 25505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:50.232033 25505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:50.232290 25505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:50.232995 25505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:50.233987 25505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:50.234066 25505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.234143 25505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:50.234195 25505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.245242 25505 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:38125
I20260806 18:39:50.245271 25712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:38125 every 8 connection(s)
I20260806 18:39:50.246377 25505 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:50.253484 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 25505
I20260806 18:39:50.253638 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:39:50.253996 12998 external_mini_cluster.cc:1428] Setting key 00e34bf9d57c85a36296a0b1f30a87bc
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:50.263792 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.248698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:48151 (local address 127.12.177.190:46135)
0806 18:39:50.248904 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:50.248908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:50.250001 (+ 1093us) server_negotiation.cc:407] Connection header received
0806 18:39:50.251471 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:50.251475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:50.251543 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:50.251624 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:50.253004 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.253919 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.255676 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.256064 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.256176 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.259299 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:50.259303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:50.259305 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:50.259334 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:50.261231 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.261977 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.261981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.261983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.262079 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.262491 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.262494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.262496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.262715 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:50.262834 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:50.263438 (+ 604us) server_negotiation.cc:299] Negotiation successful
0806 18:39:50.263597 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 18:39:50.264739 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.249130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:48151)
0806 18:39:50.249788 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:50.249844 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:50.251212 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:50.251849 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:50.251857 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:50.252283 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:50.252823 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.252837 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.254105 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.254109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.255540 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.255556 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.256248 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.256251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.256428 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.257188 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:50.257209 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:50.259077 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:50.261442 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.261451 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.261473 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.261847 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.262191 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.262194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.262196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.262377 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.262840 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:50.262851 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:50.263164 (+ 313us) client_negotiation.cc:769] Sending connection context
0806 18:39:50.263380 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 18:39:50.263772 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":243,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:39:50.266495 25713 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46135
I20260806 18:39:50.266826 25713 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:50.267468 25713 heartbeater.cc:511] Master 127.12.177.190:46135 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:39:50.269925 25420 ts_manager.cc:194] Registered new tserver with Master: 3f993fcc4bcc4cd4aecd5f6a08dee9b3 (127.12.177.129:38125)
I20260806 18:39:50.271981 25420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:48151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:39:50.292987 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:50.418922 25722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:50.419345 25722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:50.419488 25722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:50.424185 25722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:50.424279 25722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:50.424352 25722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:50.431264 25722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:50.432641 25722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:50.433858 25722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:50.446828 25728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:50.446991 25722 server_base.cc:1034] running on GCE node
W20260806 18:39:50.446849 25731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:50.446801 25729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:50.447840 25722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:50.448686 25722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:50.450214 25722 hybrid_clock.cc:648] HybridClock initialized: now 1786041590450105 us; error 64 us; skew 500 ppm
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:50.454380 25722 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:39:50.455904 25722 webserver.cc:460] Webserver started at http://127.12.177.130:38377/ using document root <none> and password file <none>
I20260806 18:39:50.456681 25722 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:50.456764 25722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:50.457024 25722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:50.459856 25722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "8163321354e04357b5131c24c86f9f31"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "6b71ce0b0ceee91009996c2eb0bba95d"
server_key_iv: "87835d069e45ae47afa80045ebb71f7a"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.460515 25722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "8163321354e04357b5131c24c86f9f31"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "6b71ce0b0ceee91009996c2eb0bba95d"
server_key_iv: "87835d069e45ae47afa80045ebb71f7a"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.467365 25722 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260806 18:39:50.470888 25742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.472571 25722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:39:50.472765 25722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "8163321354e04357b5131c24c86f9f31"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "6b71ce0b0ceee91009996c2eb0bba95d"
server_key_iv: "87835d069e45ae47afa80045ebb71f7a"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.472929 25722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:50.490854 25722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:50.495220 25722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:50.495498 25722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:50.496265 25722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:50.497277 25722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:50.497417 25722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.497483 25722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:50.497522 25722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.508759 25722 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44639
I20260806 18:39:50.508797 25907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44639 every 8 connection(s)
I20260806 18:39:50.510046 25722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:50.512434 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 25722
I20260806 18:39:50.512586 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:39:50.512938 12998 external_mini_cluster.cc:1428] Setting key 415be42126c4c33a23b346049a918377
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:39:50.528703 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.512612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45771 (local address 127.12.177.190:46135)
0806 18:39:50.512793 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:50.512799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:50.514309 (+ 1510us) server_negotiation.cc:407] Connection header received
0806 18:39:50.515516 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:50.515520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:50.515580 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:50.515694 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:50.517291 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.517960 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.520117 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.520371 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.520469 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.524187 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:50.524191 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:50.524193 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:50.524225 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:50.526100 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.526754 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.526758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.526760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.526858 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.527317 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.527320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.527322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.527547 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:50.527661 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:50.528304 (+ 643us) server_negotiation.cc:299] Negotiation successful
0806 18:39:50.528520 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:39:50.529937 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.513093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:45771)
0806 18:39:50.514117 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:50.514182 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:50.515272 (+ 1090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:50.515909 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:50.515917 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:50.516342 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:50.517053 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.517079 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.518129 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.518134 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.519764 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.519783 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.520592 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.520601 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.520918 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.521872 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:50.521900 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:50.523935 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:50.526270 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.526279 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.526309 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.526634 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.527018 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.527021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.527023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.527197 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.527662 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:50.527671 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:50.527994 (+ 323us) client_negotiation.cc:769] Sending connection context
0806 18:39:50.528215 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 18:39:50.528619 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":224,"threads_started":1}
I20260806 18:39:50.531399 25908 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46135
I20260806 18:39:50.531702 25908 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:50.532434 25908 heartbeater.cc:511] Master 127.12.177.190:46135 requested a full tablet report, sending...
I20260806 18:39:50.533843 25420 ts_manager.cc:194] Registered new tserver with Master: 8163321354e04357b5131c24c86f9f31 (127.12.177.130:44639)
I20260806 18:39:50.534765 25420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:45771
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:39:50.548837 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:50.679391 25915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:50.679723 25915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:50.679769 25915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:50.684321 25915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:50.684420 25915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:50.684511 25915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:50.690387 25915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:50.691709 25915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:50.692885 25915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:50.703855 25926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:50.703855 25921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:50.703876 25920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:50.704109 25915 server_base.cc:1034] running on GCE node
I20260806 18:39:50.704597 25915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:50.705264 25915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:50.706439 25915 hybrid_clock.cc:648] HybridClock initialized: now 1786041590706413 us; error 40 us; skew 500 ppm
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:50.709728 25915 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:39:50.710812 25915 webserver.cc:460] Webserver started at http://127.12.177.131:43333/ using document root <none> and password file <none>
I20260806 18:39:50.711448 25915 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:50.711516 25915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:50.711748 25915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:39:50.714111 25915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "0671b2618836436a93277a6090c48d77"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "ce2e04802f551f910a74ffe9456551e4"
server_key_iv: "4eeb43f15dcca84fe65376dd7ac4c3d6"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.714747 25915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "0671b2618836436a93277a6090c48d77"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "ce2e04802f551f910a74ffe9456551e4"
server_key_iv: "4eeb43f15dcca84fe65376dd7ac4c3d6"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.718954 25915 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:39:50.721771 25936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.723150 25915 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:50.723300 25915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "0671b2618836436a93277a6090c48d77"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "ce2e04802f551f910a74ffe9456551e4"
server_key_iv: "4eeb43f15dcca84fe65376dd7ac4c3d6"
server_key_version: "encryptionkey@0"
I20260806 18:39:50.723440 25915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:50.743343 25915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:50.747015 25915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:50.747255 25915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:50.748030 25915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:50.748978 25915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:50.749028 25915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.749096 25915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:50.749131 25915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:50.759291 25915 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:33847
I20260806 18:39:50.759394 26121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:33847 every 8 connection(s)
I20260806 18:39:50.760357 25915 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:50.768916 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 25915
I20260806 18:39:50.769052 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:39:50.769431 12998 external_mini_cluster.cc:1428] Setting key e4042eaa057f35bb205ed5c36f4f7bce
Aug 06 18:39:50 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041590, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:39:50.776319 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.762587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59347 (local address 127.12.177.190:46135)
0806 18:39:50.762755 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:50.762760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:50.763711 (+ 951us) server_negotiation.cc:407] Connection header received
0806 18:39:50.765083 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:50.765087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:50.765152 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:50.765299 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:50.766714 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.767493 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.768857 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.769176 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.769294 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.772387 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:50.772391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:50.772393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:50.772421 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:50.774055 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.774631 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.774634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.774636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.774740 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:50.775126 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:50.775129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:50.775130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:50.775339 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:50.775430 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:50.776052 (+ 622us) server_negotiation.cc:299] Negotiation successful
0806 18:39:50.776174 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:39:50.777251 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:50.762983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:59347)
0806 18:39:50.763540 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:50.763588 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:50.764849 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:50.765541 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:50.765550 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:50.766020 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:50.766549 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.766563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.767660 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.767664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.768689 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:50.768705 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:50.769401 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:50.769407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:50.769637 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:50.770390 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:50.770414 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:50.772195 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:39:50.774176 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.774182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.774196 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.774493 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.774854 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:39:50.774857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:39:50.774858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:39:50.775027 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:39:50.775470 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:39:50.775476 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:39:50.775774 (+ 298us) client_negotiation.cc:769] Sending connection context
0806 18:39:50.775971 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 18:39:50.776303 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":129,"threads_started":1}
I20260806 18:39:50.778684 26122 heartbeater.cc:347] Connected to a master server at 127.12.177.190:46135
I20260806 18:39:50.779002 26122 heartbeater.cc:464] Registering TS with master...
I20260806 18:39:50.779580 26122 heartbeater.cc:511] Master 127.12.177.190:46135 requested a full tablet report, sending...
I20260806 18:39:50.780761 25420 ts_manager.cc:194] Registered new tserver with Master: 0671b2618836436a93277a6090c48d77 (127.12.177.131:33847)
I20260806 18:39:50.781471 25420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:59347
I20260806 18:39:50.783798 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
Entry for principal oryx/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab.
WARNING: no policy specified for oryx/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
Entry for principal oryx/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab.
WARNING: no policy specified for oryx/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
Entry for principal oryx/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab.
I20260806 18:39:50.884644 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 25505
I20260806 18:39:50.918232 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 25722
I20260806 18:39:50.935200 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 25915
I20260806 18:39:50.953742 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 25368
I20260806 18:39:50.966207 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46135
--webserver_interface=127.12.177.190
--webserver_port=38063
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:46135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:39:51.094973 26136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:51.095284 26136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:51.095364 26136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:51.099573 26136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:39:51.099658 26136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:51.099678 26136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:51.099696 26136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:39:51.099712 26136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:39:51.105501 26136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:46135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=38063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:51.106794 26136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:51.107981 26136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:51.118654 26145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.118646 26146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.118646 26150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.118692 26136 server_base.cc:1034] running on GCE node
I20260806 18:39:51.119661 26136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:51.120870 26136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:51.122040 26136 hybrid_clock.cc:648] HybridClock initialized: now 1786041591122024 us; error 33 us; skew 500 ppm
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041591, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:51.125087 26136 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:39:51.126091 26136 webserver.cc:460] Webserver started at http://127.12.177.190:38063/ using document root <none> and password file <none>
I20260806 18:39:51.126645 26136 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:51.126721 26136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:51.130672 26136 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:39:51.133090 26159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.134689 26136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:51.134837 26136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "61b483193f2144bbb3a23280a2c4c63e"
format_stamp: "Formatted at 2026-08-06 18:39:49 on dist-test-slave-j2vl"
server_key: "d92848d4f3eccb38518e80229aa024cc"
server_key_iv: "88703bf5bc98ab281b7e6da2c8bfab9f"
server_key_version: "encryptionkey@0"
I20260806 18:39:51.135499 26136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:51.150919 26136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:51.154676 26136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:51.154973 26136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:51.163400 26136 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:46135
I20260806 18:39:51.163429 26240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:46135 every 8 connection(s)
I20260806 18:39:51.164674 26136 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:39:51.165169 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 26136
I20260806 18:39:51.165709 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:38125
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:46135
--webserver_port=37645
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:39:51.170655 26241 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:39:51.173761 26241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Bootstrap starting.
I20260806 18:39:51.200220 26241 log.cc:824] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:39:51.209892 26241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:39:51.210419 26241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Bootstrap complete.
I20260806 18:39:51.216907 26241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:51.217761 26241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b483193f2144bbb3a23280a2c4c63e, State: Initialized, Role: FOLLOWER
I20260806 18:39:51.218400 26241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:51.218600 26241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:39:51.218696 26241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:39:51.218829 26241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:39:51.221414 26241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:51.221911 26241 leader_election.cc:302] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b483193f2144bbb3a23280a2c4c63e; no voters:
I20260806 18:39:51.222303 26241 leader_election.cc:288] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 18:39:51.222476 26248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 2 FOLLOWER]: Leader election won for term 2
I20260806 18:39:51.222766 26248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [term 2 LEADER]: Becoming Leader. State: Replica: 61b483193f2144bbb3a23280a2c4c63e, State: Running, Role: LEADER
I20260806 18:39:51.223152 26248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } }
I20260806 18:39:51.223821 26241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:39:51.225008 26252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61b483193f2144bbb3a23280a2c4c63e. Latest consensus state: current_term: 2 leader_uuid: "61b483193f2144bbb3a23280a2c4c63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } } }
I20260806 18:39:51.225183 26252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:51.224982 26251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "61b483193f2144bbb3a23280a2c4c63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b483193f2144bbb3a23280a2c4c63e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46135 } } }
I20260806 18:39:51.225333 26251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e [sys.catalog]: This master's current role is: LEADER
I20260806 18:39:51.225656 26262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:39:51.229117 26262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:39:51.230291 26262 catalog_manager.cc:1259] Loaded cluster ID: 4fe48df0bfbb41f7884b9d841c2e8012
I20260806 18:39:51.230392 26262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:39:51.232298 26262 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:39:51.232981 26262 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 61b483193f2144bbb3a23280a2c4c63e: Loaded TSK: 0
I20260806 18:39:51.234133 26262 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:39:51.328827 26245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:51.329141 26245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:51.329187 26245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:51.333612 26245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:51.333701 26245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:51.333822 26245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:39:51.339964 26245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.129.keytab
--principal=oryx/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:38125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=37645
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:51.341180 26245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:51.342346 26245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:51.354055 26289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.354092 26291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.354529 26245 server_base.cc:1034] running on GCE node
W20260806 18:39:51.354064 26288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.355170 26245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:51.355955 26245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:51.357198 26245 hybrid_clock.cc:648] HybridClock initialized: now 1786041591357168 us; error 56 us; skew 500 ppm
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041591, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:51.360707 26245 init.cc:377] Logged in from keytab as oryx/127.12.177.129@KRBTEST.COM (short username oryx)
I20260806 18:39:51.361987 26245 webserver.cc:460] Webserver started at http://127.12.177.129:37645/ using document root <none> and password file <none>
I20260806 18:39:51.362854 26245 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:51.363009 26245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:51.367537 26245 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 18:39:51.370272 26306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.371728 26245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:51.371851 26245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "3f993fcc4bcc4cd4aecd5f6a08dee9b3"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "2ac961d3ff56af8948bc8a9bd920ad96"
server_key_iv: "4f2148cb26352e68f4ae98fecad6b3ef"
server_key_version: "encryptionkey@0"
I20260806 18:39:51.372493 26245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:51.391044 26245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:51.394958 26245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:51.395228 26245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:51.395977 26245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:51.396947 26245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:51.397001 26245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.397078 26245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:51.397110 26245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.407815 26245 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:38125
I20260806 18:39:51.407842 26470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:38125 every 8 connection(s)
I20260806 18:39:51.409024 26245 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:39:51.418135 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 26245
I20260806 18:39:51.418665 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:44639
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:46135
--webserver_port=38377
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.424942 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.411753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:48271)
0806 18:39:51.412348 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.412397 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.413702 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.415027 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.415035 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.415456 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.416000 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.416016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.417563 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.417566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.418657 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.418671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.420036 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.420040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.420209 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.420929 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.420950 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.423790 (+ 2840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":176,"threads_started":1}
W20260806 18:39:51.425208 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.411616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:48271 (local address 127.12.177.190:46135)
0806 18:39:51.412152 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.412174 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.412535 (+ 361us) server_negotiation.cc:407] Connection header received
0806 18:39:51.414157 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.414170 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.414539 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.414881 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.416215 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.417394 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.418857 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.419808 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.420041 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.424182 (+ 4141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:48271: BlockingRecv error: recv got EOF from 127.12.177.129:48271 (error 108)
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":119,"threads_started":1}
W20260806 18:39:51.425797 26471 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:46135 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.177.190:46135: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.432431 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.426333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:43025)
0806 18:39:51.426559 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.426580 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.426657 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.426940 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.426942 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.427104 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.427211 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.427216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.428394 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.428396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.428947 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.428955 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.429699 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.429702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.429785 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.430361 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.430374 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.432309 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121}
W20260806 18:39:51.432667 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.426477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:43025 (local address 127.12.177.190:46135)
0806 18:39:51.426640 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.426646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.426668 (+ 22us) server_negotiation.cc:407] Connection header received
0806 18:39:51.426731 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.426737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.426806 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.426918 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.427336 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.428249 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.429083 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.429552 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.429693 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.432537 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:43025: BlockingRecv error: recv got EOF from 127.12.177.129:43025 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.439604 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.433255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:60173)
0806 18:39:51.433458 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.433474 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.433561 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.433802 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.433805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.433987 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.434100 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.434107 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.434931 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.434935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.435834 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.435845 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.436394 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.436398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.436488 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.437053 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.437069 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.439463 (+ 2394us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 18:39:51.439925 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.433416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:60173 (local address 127.12.177.190:46135)
0806 18:39:51.433545 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.433548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.433563 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:51.433651 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.433654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.433694 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.433761 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.434256 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.434810 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.436026 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.436257 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.436359 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.439793 (+ 3434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:60173: BlockingRecv error: recv got EOF from 127.12.177.129:60173 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 18:39:51.440176 26471 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:39:51.544811 26478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:51.545118 26478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:51.545166 26478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:51.550109 26478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:51.550186 26478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:51.550273 26478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:39:51.556145 26478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.130.keytab
--principal=oryx/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:44639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=38377
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:51.557485 26478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:51.558648 26478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:51.574375 26487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.574384 26486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.574903 26489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.577304 26478 server_base.cc:1034] running on GCE node
I20260806 18:39:51.577924 26478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:51.578686 26478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:51.579931 26478 hybrid_clock.cc:648] HybridClock initialized: now 1786041591579907 us; error 36 us; skew 500 ppm
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041591, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:51.583235 26478 init.cc:377] Logged in from keytab as oryx/127.12.177.130@KRBTEST.COM (short username oryx)
I20260806 18:39:51.584399 26478 webserver.cc:460] Webserver started at http://127.12.177.130:38377/ using document root <none> and password file <none>
I20260806 18:39:51.585057 26478 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:51.585142 26478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:51.589681 26478 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:51.592047 26503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.593545 26478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:39:51.593686 26478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "8163321354e04357b5131c24c86f9f31"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "6b71ce0b0ceee91009996c2eb0bba95d"
server_key_iv: "87835d069e45ae47afa80045ebb71f7a"
server_key_version: "encryptionkey@0"
I20260806 18:39:51.594399 26478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:51.613602 26478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:51.617656 26478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:51.617861 26478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:51.618520 26478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:51.619439 26478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:51.619488 26478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.619544 26478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:51.619563 26478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.630010 26478 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44639
I20260806 18:39:51.630012 26676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44639 every 8 connection(s)
I20260806 18:39:51.631181 26478 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:39:51.638285 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 26478
I20260806 18:39:51.638860 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:33847
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:46135
--webserver_port=43333
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 18:39:51.646581 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.633465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:38925 (local address 127.12.177.190:46135)
0806 18:39:51.633618 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.633622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.634729 (+ 1107us) server_negotiation.cc:407] Connection header received
0806 18:39:51.636192 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.636196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.636273 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.636400 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.637899 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.638763 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.640295 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.640749 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.640880 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.646453 (+ 5573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:38925: BlockingRecv error: recv got EOF from 127.12.177.130:38925 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:39:51.647495 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.633939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:38925)
0806 18:39:51.634518 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.634571 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.635917 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.636626 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.636634 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.637079 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.637728 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.637745 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.639001 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.639007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.640150 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.640161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.641024 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.641030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.641297 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.642086 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.642115 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.646062 (+ 3947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":147,"threads_started":1}
W20260806 18:39:51.648110 26677 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:46135 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.177.190:46135: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.655320 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.648715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:43041)
0806 18:39:51.648914 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.648932 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.649040 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.649480 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.649482 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.649654 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.649771 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.649776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.651031 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.651034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.651606 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.651616 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.652341 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.652344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.652429 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.653117 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.653131 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.655192 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260806 18:39:51.655529 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.648873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:43041 (local address 127.12.177.190:46135)
0806 18:39:51.649058 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.649065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.649108 (+ 43us) server_negotiation.cc:407] Connection header received
0806 18:39:51.649176 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.649182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.649246 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.649377 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.649911 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.650839 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.651743 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.652182 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.652317 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.655393 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:43041: BlockingRecv error: recv got EOF from 127.12.177.130:43041 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.662688 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.656314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:56767)
0806 18:39:51.656422 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.656439 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.656529 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.656818 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.656821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.656985 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.657075 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.657080 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.658209 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.658212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.658764 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.658774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.659389 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.659392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.659463 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.660135 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.660153 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.662560 (+ 2407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 18:39:51.663035 26677 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:39:51.663285 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.656398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:56767 (local address 127.12.177.190:46135)
0806 18:39:51.656516 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.656520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.656536 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:51.656617 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.656620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.656667 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.656752 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.657190 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.658042 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.658886 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.659243 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.659351 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.662819 (+ 3468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:56767: BlockingRecv error: recv got EOF from 127.12.177.130:56767 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 18:39:51.769200 26680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:39:51.769589 26680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:39:51.769680 26680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:39:51.774016 26680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:39:51.774097 26680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:39:51.774195 26680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:39:51.780274 26680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/krb5kdc/oryx_127.12.177.131.keytab
--principal=oryx/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:33847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=43333
--tserver_master_addrs=127.12.177.190:46135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:39:51.781699 26680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:39:51.782914 26680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:39:51.794171 26686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:39:51.794175 26687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.794231 26680 server_base.cc:1034] running on GCE node
W20260806 18:39:51.794171 26689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:39:51.795233 26680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:39:51.796003 26680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:39:51.797205 26680 hybrid_clock.cc:648] HybridClock initialized: now 1786041591797164 us; error 57 us; skew 500 ppm
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041591, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:39:51.800554 26680 init.cc:377] Logged in from keytab as oryx/127.12.177.131@KRBTEST.COM (short username oryx)
I20260806 18:39:51.801677 26680 webserver.cc:460] Webserver started at http://127.12.177.131:43333/ using document root <none> and password file <none>
I20260806 18:39:51.802275 26680 fs_manager.cc:359] Metadata directory not provided
I20260806 18:39:51.802361 26680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:39:51.806747 26680 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 18:39:51.809042 26698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.810514 26680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:39:51.810667 26680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "0671b2618836436a93277a6090c48d77"
format_stamp: "Formatted at 2026-08-06 18:39:50 on dist-test-slave-j2vl"
server_key: "ce2e04802f551f910a74ffe9456551e4"
server_key_iv: "4eeb43f15dcca84fe65376dd7ac4c3d6"
server_key_version: "encryptionkey@0"
I20260806 18:39:51.811285 26680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:39:51.838929 26680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:39:51.842849 26680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:39:51.843091 26680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:39:51.843778 26680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:39:51.844726 26680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:39:51.844785 26680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.844828 26680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:39:51.844844 26680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:39:51.856199 26680 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:33847
I20260806 18:39:51.856225 26864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:33847 every 8 connection(s)
I20260806 18:39:51.857504 26680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:39:51.859961 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 26680
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.872382 26871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.861116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.12.177.190:46135)
0806 18:39:51.861380 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.861384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.861695 (+ 311us) server_negotiation.cc:407] Connection header received
0806 18:39:51.861828 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.861830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.861884 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.861974 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.863122 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.863707 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.865179 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.865585 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.865691 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.867403 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:39:51.867409 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:39:51.867427 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:39:51.867462 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:39:51.869841 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:51.870451 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:51.870462 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:51.870468 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:51.870609 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:39:51.870963 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:39:51.870967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:39:51.870968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:39:51.871380 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:39:51.871563 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 18:39:51.871964 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 18:39:51.872238 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":170,"thread_start_us":79,"threads_started":1}
W20260806 18:39:51.872684 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.859735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:44247 (local address 127.12.177.190:46135)
0806 18:39:51.859931 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.859935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.861235 (+ 1300us) server_negotiation.cc:407] Connection header received
0806 18:39:51.863221 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.863224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.863277 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.863346 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.865175 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.865874 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.867337 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.867563 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.867643 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.872577 (+ 4934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:44247: BlockingRecv error: recv got EOF from 127.12.177.131:44247 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 18:39:51.873597 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.860367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:44247)
0806 18:39:51.861063 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.861128 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.862949 (+ 1821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.863564 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.863572 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.864239 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.865009 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.865036 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.866044 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.866048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.867150 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.867163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.867746 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.867753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.868046 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.868757 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.868785 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.872469 (+ 3684us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":200,"threads_started":1}
W20260806 18:39:51.874159 26865 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:46135 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.177.190:46135: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.880358 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.874715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:49939)
0806 18:39:51.874841 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.874858 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.874942 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.875435 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.875439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.875646 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.875773 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.875781 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.876654 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.876657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.877331 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.877387 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.877848 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.877851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.877926 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.878394 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.878406 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.880249 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 18:39:51.880560 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.875076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:49939 (local address 127.12.177.190:46135)
0806 18:39:51.875211 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.875216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.875229 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:39:51.875271 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.875274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.875318 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.875412 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.875922 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.876530 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.877505 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.877734 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.877829 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.880424 (+ 2595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:49939: BlockingRecv error: recv got EOF from 127.12.177.131:49939 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:51 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:51.886426 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:51.881026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:36859)
0806 18:39:51.881157 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:51.881174 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:51.881262 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:51.881577 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:51.881580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:51.881745 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:51.881824 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.881829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.882647 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.882651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.883194 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:51.883203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.883665 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.883669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:51.883757 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.884258 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:51.884269 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:51.886251 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 18:39:51.886497 26474 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:51.881119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:36859 (local address 127.12.177.190:46135)
0806 18:39:51.881305 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:51.881317 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:51.881329 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:39:51.881426 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:51.881429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:51.881467 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:51.881558 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:51.881940 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.882537 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.883327 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:51.883545 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:51.883651 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:51.886380 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:36859: BlockingRecv error: recv got EOF from 127.12.177.131:36859 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
W20260806 18:39:51.887005 26865 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:52.447369 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:52.440942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:57537)
0806 18:39:52.441308 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:52.441326 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:52.441505 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:52.441825 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:52.441827 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:52.442023 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:52.442131 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.442136 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.443040 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.443043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.443667 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.443676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.444188 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.444191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.444276 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.444961 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:52.444985 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:52.447206 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":87,"threads_started":1}
W20260806 18:39:52.447621 26873 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:52.441003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:57537 (local address 127.12.177.190:46135)
0806 18:39:52.441337 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:52.441343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:52.441458 (+ 115us) server_negotiation.cc:407] Connection header received
0806 18:39:52.441625 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:52.441628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:52.441681 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:52.441778 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:52.442293 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.442889 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.443796 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.444052 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.444148 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.447442 (+ 3294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:57537: BlockingRecv error: recv got EOF from 127.12.177.129:57537 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":98,"threads_started":1}
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:52.669932 26874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:52.663776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:45319)
0806 18:39:52.664122 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:52.664135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:52.664240 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:52.664482 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:52.664484 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:52.664680 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:52.664783 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.664788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.665617 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.665620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.666228 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.666240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.666779 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.666783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.666879 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.667521 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:52.667536 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:52.669729 (+ 2193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":120,"threads_started":1}
W20260806 18:39:52.670027 26873 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:52.663842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45319 (local address 127.12.177.190:46135)
0806 18:39:52.664007 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:52.664010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:52.664206 (+ 196us) server_negotiation.cc:407] Connection header received
0806 18:39:52.664320 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:52.664322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:52.664369 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:52.664441 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:52.664889 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.665487 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.666403 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.666644 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.666737 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.669889 (+ 3152us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:45319: BlockingRecv error: recv got EOF from 127.12.177.130:45319 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:52 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:52.894541 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:52.887758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:34661)
0806 18:39:52.888137 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:52.888162 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:52.888317 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:52.888671 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:52.888675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:52.888988 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:52.889138 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.889146 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.890104 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.890108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.890712 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:52.890722 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.891243 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.891247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:52.891351 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.891975 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:52.891987 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:52.894293 (+ 2306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":101,"threads_started":1}
W20260806 18:39:52.894585 26873 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:52.887931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:34661 (local address 127.12.177.190:46135)
0806 18:39:52.888113 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:52.888119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:52.888247 (+ 128us) server_negotiation.cc:407] Connection header received
0806 18:39:52.888483 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:52.888485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:52.888542 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:52.888645 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:52.889285 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.889942 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.890853 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:52.891102 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:52.891221 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:52.894473 (+ 3252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:34661: BlockingRecv error: recv got EOF from 127.12.177.131:34661 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:53.454268 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:53.448407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:60611)
0806 18:39:53.448736 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:53.448752 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:53.448881 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:53.449167 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:53.449169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:53.449409 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:53.449518 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.449524 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.450362 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.450365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.450940 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.450949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.451450 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.451452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.451519 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.452075 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:53.452088 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:53.454098 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":123,"threads_started":1}
W20260806 18:39:53.454424 26879 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:53.448550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:60611 (local address 127.12.177.190:46135)
0806 18:39:53.448802 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:53.448805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:53.448821 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:53.448976 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:53.448979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:53.449028 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:53.449116 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:53.449683 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.450237 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.451074 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.451330 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.451424 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.454271 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:60611: BlockingRecv error: recv got EOF from 127.12.177.129:60611 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:53.677811 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:53.671018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:39749)
0806 18:39:53.671350 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:53.671421 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:53.671657 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:53.672018 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:53.672020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:53.672223 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:53.672333 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.672338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.673233 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.673236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.673923 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.673934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.674484 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.674487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.674564 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.675198 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:53.675215 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:53.677593 (+ 2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":145,"threads_started":1}
W20260806 18:39:53.677875 26879 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:53.671172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:39749 (local address 127.12.177.190:46135)
0806 18:39:53.671331 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:53.671335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:53.671631 (+ 296us) server_negotiation.cc:407] Connection header received
0806 18:39:53.671802 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:53.671805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:53.671863 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:53.671946 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:53.672492 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.673078 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.674046 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.674276 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.674409 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.677746 (+ 3337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:39749: BlockingRecv error: recv got EOF from 127.12.177.130:39749 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:53 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:53.902369 26882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:53.895739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:38213)
0806 18:39:53.896197 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:53.896214 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:53.896361 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:53.896728 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:53.896731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:53.896992 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:53.897142 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.897150 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.898171 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.898174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.898751 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:53.898760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.899350 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.899354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:53.899428 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.900065 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:53.900078 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:53.902200 (+ 2122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":156,"threads_started":1}
W20260806 18:39:53.902484 26879 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:53.895970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:38213 (local address 127.12.177.190:46135)
0806 18:39:53.896121 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:53.896125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:53.896297 (+ 172us) server_negotiation.cc:407] Connection header received
0806 18:39:53.896476 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:53.896480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:53.896562 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:53.896671 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:53.897286 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.898058 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.898889 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:53.899193 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:53.899276 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:53.902380 (+ 3104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:38213: BlockingRecv error: recv got EOF from 127.12.177.131:38213 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:54.461382 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:54.455408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:41659)
0806 18:39:54.455759 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:54.455776 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:54.455876 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:54.456158 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:54.456160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:54.456358 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:54.456469 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.456474 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.457313 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.457316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.457981 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.457994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.458455 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.458458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.458528 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.459187 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:54.459201 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:54.461179 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
W20260806 18:39:54.461760 26885 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:54.455510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:41659 (local address 127.12.177.190:46135)
0806 18:39:54.455815 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:54.455819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:54.455834 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:54.455988 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:54.455990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:54.456037 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:54.456121 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:54.456602 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.457165 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.458107 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.458340 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.458431 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.461553 (+ 3122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:41659: BlockingRecv error: recv got EOF from 127.12.177.129:41659 (error 108)
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:54.686393 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:54.679059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:49253)
0806 18:39:54.679406 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:54.679431 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:54.679633 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:54.680194 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:54.680197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:54.680603 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:54.680756 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.680942 (+ 186us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.681985 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.681989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.682602 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.682612 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.683180 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.683184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.683297 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.683939 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:54.683953 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:54.686183 (+ 2230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":139,"threads_started":1}
W20260806 18:39:54.686528 26885 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:54.679256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:49253 (local address 127.12.177.190:46135)
0806 18:39:54.679413 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:54.679421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:54.679677 (+ 256us) server_negotiation.cc:407] Connection header received
0806 18:39:54.679941 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:54.679944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:54.680021 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:54.680155 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:54.681146 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.681844 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.682759 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.683015 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.683135 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.686383 (+ 3248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:49253: BlockingRecv error: recv got EOF from 127.12.177.130:49253 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:54 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:54.912251 26887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:54.903306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:33501)
0806 18:39:54.903612 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:54.903627 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:54.903728 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:54.904027 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:54.904030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:54.904228 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:54.904342 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.904348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.905143 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.905146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.905793 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:54.905804 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.906240 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.906243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:54.906318 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.909914 (+ 3596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:54.909932 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:54.911971 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":87,"threads_started":1}
W20260806 18:39:54.912339 26885 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:54.903484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:33501 (local address 127.12.177.190:46135)
0806 18:39:54.903660 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:54.903664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:54.903680 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:54.903824 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:54.903826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:54.903877 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:54.903950 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:54.904458 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.905002 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.905904 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:54.906124 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:54.906207 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:54.912192 (+ 5985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:33501: BlockingRecv error: recv got EOF from 127.12.177.131:33501 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:55.469462 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:55.462667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:51859)
0806 18:39:55.463096 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:55.463116 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:55.463254 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:55.463671 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:55.463674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:55.463887 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:55.464003 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.464009 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.464971 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.464975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.465800 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.465812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.466360 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.466364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.466454 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.467099 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:55.467113 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:55.469290 (+ 2177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":142,"threads_started":1}
W20260806 18:39:55.469766 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:55.462857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:51859 (local address 127.12.177.190:46135)
0806 18:39:55.463146 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:55.463156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:55.463237 (+ 81us) server_negotiation.cc:407] Connection header received
0806 18:39:55.463432 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:55.463435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:55.463491 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:55.463588 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:55.464233 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.464812 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.465922 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.466230 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.466320 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.469612 (+ 3292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:51859: BlockingRecv error: recv got EOF from 127.12.177.129:51859 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":102,"threads_started":1}
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:55.694264 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:55.687659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:51583)
0806 18:39:55.688147 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:55.688167 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:55.688289 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:55.688612 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:55.688615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:55.688940 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:55.689092 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.689101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.690148 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.690159 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.690750 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.690760 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.691269 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.691272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.691347 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.691980 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:55.691995 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:55.694129 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":147,"threads_started":1}
W20260806 18:39:55.694521 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:55.687810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:51583 (local address 127.12.177.190:46135)
0806 18:39:55.688008 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:55.688013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:55.688275 (+ 262us) server_negotiation.cc:407] Connection header received
0806 18:39:55.688370 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:55.688375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:55.688443 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:55.688576 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:55.689274 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.690019 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.690894 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.691119 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.691210 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.694392 (+ 3182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:51583: BlockingRecv error: recv got EOF from 127.12.177.130:51583 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:55 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:55.919855 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:55.913571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:43373)
0806 18:39:55.913867 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:55.913892 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:55.913999 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:55.914284 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:55.914287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:55.914551 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:55.914659 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.914665 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.915698 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.915703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.916340 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:55.916349 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.916909 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.916913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:55.916995 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.917703 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:55.917716 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:55.919668 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":102,"threads_started":1}
W20260806 18:39:55.919993 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:55.913674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:43373 (local address 127.12.177.190:46135)
0806 18:39:55.913825 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:55.913829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:55.913990 (+ 161us) server_negotiation.cc:407] Connection header received
0806 18:39:55.914071 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:55.914075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:55.914140 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:55.914255 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:55.914814 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.915592 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.916534 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:55.916783 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:55.916901 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:55.919834 (+ 2933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:43373: BlockingRecv error: recv got EOF from 127.12.177.131:43373 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:56.477548 26894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:56.470603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:46025)
0806 18:39:56.470881 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:56.470897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:56.470998 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:56.471965 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:56.471968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:56.472164 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:56.472279 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.472285 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.473137 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.473140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.473806 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.473817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.474378 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.474382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.474456 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.475110 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:56.475124 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:56.477419 (+ 2295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
W20260806 18:39:56.477797 26895 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:56.470686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:46025 (local address 127.12.177.190:46135)
0806 18:39:56.471711 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:56.471718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:56.471734 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:39:56.471773 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:56.471776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:56.471830 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:56.471908 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:56.472417 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.473018 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.473959 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.474215 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.474310 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.477574 (+ 3264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:46025: BlockingRecv error: recv got EOF from 127.12.177.129:46025 (error 108)
Metrics: {"server-negotiator.queue_time_us":940,"thread_start_us":73,"threads_started":1}
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:56.701990 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:56.695336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:41611)
0806 18:39:56.695714 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:56.695732 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:56.695868 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:56.696185 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:56.696188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:56.696422 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:56.696532 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.696538 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.697334 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.697380 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.698006 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.698020 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.698574 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.698579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.698671 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.699252 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:56.699265 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:56.701830 (+ 2565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
W20260806 18:39:56.702068 26895 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:56.695572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:41611 (local address 127.12.177.190:46135)
0806 18:39:56.695733 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:56.695739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:56.695820 (+ 81us) server_negotiation.cc:407] Connection header received
0806 18:39:56.696000 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:56.696003 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:56.696063 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:56.696156 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:56.696662 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.697210 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.698150 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.698416 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.698536 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.701944 (+ 3408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:41611: BlockingRecv error: recv got EOF from 127.12.177.130:41611 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:56 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:56.929231 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:56.921023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:53783)
0806 18:39:56.921451 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:56.921469 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:56.921652 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:56.921959 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:56.921963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:56.922242 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:56.922372 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.922383 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.923248 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.923253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.924214 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:56.924225 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.925517 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.925521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:56.925612 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.926248 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:56.926262 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:56.929093 (+ 2831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":106,"threads_started":1}
W20260806 18:39:56.929543 26895 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:56.921186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:53783 (local address 127.12.177.190:46135)
0806 18:39:56.921437 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:56.921442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:56.921586 (+ 144us) server_negotiation.cc:407] Connection header received
0806 18:39:56.921761 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:56.921764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:56.921827 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:56.921931 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:56.922479 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.923129 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.924381 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:56.925319 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:56.925520 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:56.929409 (+ 3889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:53783: BlockingRecv error: recv got EOF from 127.12.177.131:53783 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:57.485992 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:57.478597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:45521)
0806 18:39:57.479111 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:57.479128 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:57.479260 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:57.479595 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:57.479597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:57.479804 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:57.479942 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.479948 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.480926 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.480930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.481764 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.481778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.482474 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.482478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.482578 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.483255 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:57.483269 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:57.485856 (+ 2587us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":106,"threads_started":1}
W20260806 18:39:57.486316 26899 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:57.478840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:45521 (local address 127.12.177.190:46135)
0806 18:39:57.479131 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:57.479134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:57.479307 (+ 173us) server_negotiation.cc:407] Connection header received
0806 18:39:57.479365 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:57.479367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:57.479419 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:57.479515 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:57.480106 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.480661 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.482009 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.482333 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.482467 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.486170 (+ 3703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:45521: BlockingRecv error: recv got EOF from 127.12.177.129:45521 (error 108)
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":99,"threads_started":1}
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:57.709668 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:57.702929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:53869)
0806 18:39:57.703331 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:57.703351 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:57.703516 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:57.703821 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:57.703823 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:57.704069 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:57.704166 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.704172 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.705126 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.705131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.706010 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.706021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.706486 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.706489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.706553 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.707111 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:57.707124 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:57.709484 (+ 2360us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":132,"threads_started":1}
W20260806 18:39:57.709764 26899 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:57.703129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:53869 (local address 127.12.177.190:46135)
0806 18:39:57.703331 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:57.703336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:57.703462 (+ 126us) server_negotiation.cc:407] Connection header received
0806 18:39:57.703633 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:57.703636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:57.703694 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:57.703789 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:57.704302 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.704985 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.706130 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.706357 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.706464 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.709640 (+ 3176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:53869: BlockingRecv error: recv got EOF from 127.12.177.130:53869 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:57 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:57.937426 26903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:57.930187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:56657)
0806 18:39:57.930518 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:57.930535 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:57.930661 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:57.931139 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:57.931142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:57.931359 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:57.931468 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.931475 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.932415 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.932419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.933018 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:57.933030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.933555 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.933558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:57.933642 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.934223 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:57.934237 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:57.937025 (+ 2788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":135,"threads_started":1}
W20260806 18:39:57.937623 26899 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:57.930545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:56657 (local address 127.12.177.190:46135)
0806 18:39:57.930720 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:57.930724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:57.930738 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:39:57.930772 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:57.930774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:57.930821 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:57.930898 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:57.931638 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.932246 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.933160 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:57.933429 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:57.933525 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:57.937304 (+ 3779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:56657: BlockingRecv error: recv got EOF from 127.12.177.131:56657 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:58.493813 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:58.486958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:48891)
0806 18:39:58.487367 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:58.487382 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:58.487484 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:58.487844 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:58.487847 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:58.488055 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:58.488159 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.488164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.489026 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.489029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.489719 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.489730 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.490264 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.490268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.490360 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.491038 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:58.491052 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:58.493668 (+ 2616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":114,"threads_started":1}
W20260806 18:39:58.493953 26905 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:58.487035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:48891 (local address 127.12.177.190:46135)
0806 18:39:58.487338 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:58.487341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:58.487453 (+ 112us) server_negotiation.cc:407] Connection header received
0806 18:39:58.487615 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:58.487618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:58.487674 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:58.487761 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:58.488309 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.488857 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.489885 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.490128 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.490218 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.493775 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:48891: BlockingRecv error: recv got EOF from 127.12.177.129:48891 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":100,"threads_started":1}
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:58.717141 26908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:58.710667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:44477)
0806 18:39:58.711120 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:58.711135 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:58.711242 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:58.711594 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:58.711597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:58.711861 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:58.712047 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.712059 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.712996 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.713001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.713611 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.713621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.714120 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.714124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.714214 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.714770 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:58.714783 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:58.716944 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":94,"threads_started":1}
W20260806 18:39:58.717206 26905 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:58.710871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:44477 (local address 127.12.177.190:46135)
0806 18:39:58.711087 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:58.711092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:58.711218 (+ 126us) server_negotiation.cc:407] Connection header received
0806 18:39:58.711364 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:58.711368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:58.711427 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:58.711529 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:58.712163 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.712868 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.713743 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.713986 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.714099 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.717093 (+ 2994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:44477: BlockingRecv error: recv got EOF from 127.12.177.130:44477 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:58 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:58.946147 26909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:58.938454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:54235)
0806 18:39:58.939016 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:58.939040 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:58.939212 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:58.939950 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:58.939954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:58.940225 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:58.940361 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.940368 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.941201 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.941204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.941882 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:58.941893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.942430 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.942434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:58.942526 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.943337 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:58.943351 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:58.945953 (+ 2602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":212,"threads_started":1}
W20260806 18:39:58.946250 26905 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:58.938706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:54235 (local address 127.12.177.190:46135)
0806 18:39:58.938942 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:58.938947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:58.939146 (+ 199us) server_negotiation.cc:407] Connection header received
0806 18:39:58.939370 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:58.939375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:58.939436 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:58.939929 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:58.940505 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.941074 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.942028 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:58.942280 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:58.942402 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:58.946123 (+ 3721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:54235: BlockingRecv error: recv got EOF from 127.12.177.131:54235 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:59.500897 26910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:59.494917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:38543)
0806 18:39:59.495237 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:59.495252 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:59.495349 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:59.495641 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:59.495643 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:59.495835 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:59.495961 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.495966 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.496820 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.496824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.497516 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.497526 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.498070 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.498074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.498158 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.498771 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:59.498784 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:59.500763 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":123,"threads_started":1}
W20260806 18:39:59.501235 26912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:59.495158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:38543 (local address 127.12.177.190:46135)
0806 18:39:59.495418 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:59.495422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:59.495437 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:39:59.495476 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:59.495478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:59.495523 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:59.495604 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:59.496101 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.496665 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.497661 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.497922 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.498018 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.500960 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:38543: BlockingRecv error: recv got EOF from 127.12.177.129:38543 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":105,"threads_started":1}
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:59.725895 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:59.718201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:37063)
0806 18:39:59.718519 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:59.718533 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:59.718644 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:59.719027 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:59.719033 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:59.719256 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:59.719388 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.719394 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.720430 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.720433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.721161 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.721174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.721749 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.721752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.721821 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.722693 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:59.722708 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:59.725656 (+ 2948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":103,"threads_started":1}
W20260806 18:39:59.726210 26912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:59.718278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:37063 (local address 127.12.177.190:46135)
0806 18:39:59.718488 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:59.718492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:59.718623 (+ 131us) server_negotiation.cc:407] Connection header received
0806 18:39:59.718730 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:59.718733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:59.718813 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:59.718995 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:59.719554 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.720291 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.721308 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.721586 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.721688 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.725889 (+ 4201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:37063: BlockingRecv error: recv got EOF from 127.12.177.130:37063 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:39:59 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:39:59.958453 26918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:39:59.947301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:41677)
0806 18:39:59.947784 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 18:39:59.947801 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:39:59.947913 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:39:59.948232 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:39:59.948237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:39:59.948475 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:39:59.948595 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.948602 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.949761 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.949766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.950374 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:39:59.950384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.950891 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.950896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:39:59.950981 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.956120 (+ 5139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:39:59.956137 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:39:59.958268 (+ 2131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":121,"threads_started":1}
W20260806 18:39:59.958601 26912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:39:59.947442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:41677 (local address 127.12.177.190:46135)
0806 18:39:59.947630 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 18:39:59.947640 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:39:59.947916 (+ 276us) server_negotiation.cc:407] Connection header received
0806 18:39:59.947981 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:39:59.947984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:39:59.948051 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:39:59.948148 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:39:59.948739 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.949614 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.950515 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:39:59.950763 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:39:59.950882 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:39:59.958472 (+ 7590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:41677: BlockingRecv error: recv got EOF from 127.12.177.131:41677 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:00.511620 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:00.502279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:38247)
0806 18:40:00.502628 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:00.502648 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:00.503156 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:00.504160 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:00.504163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:00.504806 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:00.504932 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.504939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.506647 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.506651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.507259 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.507270 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.508082 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.508086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.508166 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.508978 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:00.508994 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:00.511448 (+ 2454us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":105,"threads_started":1}
W20260806 18:40:00.511962 26924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:00.502330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:38247 (local address 127.12.177.190:46135)
0806 18:40:00.502666 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:00.502673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:00.502831 (+ 158us) server_negotiation.cc:407] Connection header received
0806 18:40:00.503534 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:00.503542 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:00.503793 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:00.504083 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:00.505209 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.506132 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.507466 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.507878 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.507970 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.511803 (+ 3833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:38247: BlockingRecv error: recv got EOF from 127.12.177.129:38247 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":107,"threads_started":1}
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:00.733680 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:00.726844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:42453)
0806 18:40:00.727174 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:00.727189 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:00.727316 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:00.727641 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:00.727644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:00.727846 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:00.727960 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.727966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.728876 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.728880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.729578 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.729589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.730248 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.730252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.730327 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.731027 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:00.731040 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:00.733518 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":84,"threads_started":1}
W20260806 18:40:00.733959 26924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:00.726943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:42453 (local address 127.12.177.190:46135)
0806 18:40:00.727161 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:00.727164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:00.727276 (+ 112us) server_negotiation.cc:407] Connection header received
0806 18:40:00.727418 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:00.727421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:00.727473 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:00.727547 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:00.728167 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.728748 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.729781 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.730049 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.730147 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.733799 (+ 3652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:42453: BlockingRecv error: recv got EOF from 127.12.177.130:42453 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:00 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:00.969038 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:00.959888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:46231)
0806 18:40:00.960249 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:00.960265 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:00.960424 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:00.961110 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:00.961114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:00.961463 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:00.961647 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.961659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.962709 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.962712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.963617 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:00.963630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.964565 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.964570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:00.964755 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.965771 (+ 1016us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:00.965788 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:00.968890 (+ 3102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":134,"threads_started":1}
W20260806 18:40:00.969652 26924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:00.960048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:46231 (local address 127.12.177.190:46135)
0806 18:40:00.960235 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:00.960239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:00.960426 (+ 187us) server_negotiation.cc:407] Connection header received
0806 18:40:00.960687 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:00.960692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:00.960836 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:00.960995 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:00.961855 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.962465 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.963860 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:00.964170 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:00.964322 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:00.969304 (+ 4982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:46231: BlockingRecv error: recv got EOF from 127.12.177.131:46231 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:01.520654 26930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:01.512961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:36969)
0806 18:40:01.513634 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:01.513651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:01.513820 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:01.514166 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:01.514168 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:01.514384 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:01.514521 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.514527 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.515875 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.515879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.516591 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.516605 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.517199 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.517202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.517278 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.517965 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:01.517978 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:01.520456 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":153,"threads_started":1}
W20260806 18:40:01.520831 26931 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:01.513204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:36969 (local address 127.12.177.190:46135)
0806 18:40:01.513507 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:01.513511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:01.513787 (+ 276us) server_negotiation.cc:407] Connection header received
0806 18:40:01.513928 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:01.513930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:01.513989 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:01.514083 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:01.514798 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.515698 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.516794 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.517055 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.517157 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.520683 (+ 3526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:36969: BlockingRecv error: recv got EOF from 127.12.177.129:36969 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":77,"threads_started":1}
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:01.741387 26934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:01.734730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:45021)
0806 18:40:01.735179 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:01.735195 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:01.735349 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:01.735685 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:01.735689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:01.735924 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:01.736028 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.736035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.736843 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.736847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.737722 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.737733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.738242 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.738246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.738333 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.738932 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:01.738948 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:01.741174 (+ 2226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":128,"threads_started":1}
W20260806 18:40:01.741811 26931 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:01.734923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45021 (local address 127.12.177.190:46135)
0806 18:40:01.735131 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:01.735136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:01.735289 (+ 153us) server_negotiation.cc:407] Connection header received
0806 18:40:01.735498 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:01.735502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:01.735560 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:01.735656 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:01.736156 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.736716 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.737845 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.738091 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.738214 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.741448 (+ 3234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:45021: BlockingRecv error: recv got EOF from 127.12.177.130:45021 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:01 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:01.977140 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:01.970420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:50137)
0806 18:40:01.970830 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:01.970846 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:01.970992 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:01.971430 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:01.971435 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:01.971654 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:01.971756 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.971762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.972629 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.972634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.973213 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:01.973222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.973746 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.973749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:01.973831 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.974437 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:01.974449 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:01.976980 (+ 2531us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":129,"threads_started":1}
W20260806 18:40:01.977420 26931 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:01.970637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:50137 (local address 127.12.177.190:46135)
0806 18:40:01.970788 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:01.970793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:01.970932 (+ 139us) server_negotiation.cc:407] Connection header received
0806 18:40:01.971103 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:01.971107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:01.971174 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:01.971262 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:01.971896 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.972505 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.973378 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:01.973616 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:01.973737 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:01.977200 (+ 3463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:50137: BlockingRecv error: recv got EOF from 127.12.177.131:50137 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:02.528287 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:02.521821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:42115)
0806 18:40:02.522140 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:02.522168 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:02.522274 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:02.522547 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:02.522551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:02.522765 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:02.522879 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.522885 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.523724 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.523728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.524350 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.524362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.524936 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.524939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.525010 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.525719 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:02.525733 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:02.528092 (+ 2359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":82,"threads_started":1}
W20260806 18:40:02.528434 26937 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:02.521981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42115 (local address 127.12.177.190:46135)
0806 18:40:02.522269 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:02.522273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:02.522289 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:40:02.522354 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:02.522356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:02.522400 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:02.522492 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:02.523001 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.523550 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.524485 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.524806 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.524899 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.528259 (+ 3360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:42115: BlockingRecv error: recv got EOF from 127.12.177.129:42115 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":87,"threads_started":1}
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:02.748768 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:02.742721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:55431)
0806 18:40:02.743107 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:02.743129 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:02.743280 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:02.743618 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:02.743621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:02.743857 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:02.743956 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.743962 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.744736 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.744740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.745307 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.745316 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.745844 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.745848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.745930 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.746525 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:02.746539 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:02.748574 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":120,"threads_started":1}
W20260806 18:40:02.748889 26937 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:02.742782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:55431 (local address 127.12.177.190:46135)
0806 18:40:02.743024 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:02.743030 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:02.743213 (+ 183us) server_negotiation.cc:407] Connection header received
0806 18:40:02.743429 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:02.743434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:02.743492 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:02.743584 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:02.744074 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.744620 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.745464 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.745711 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.745826 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.748730 (+ 2904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:55431: BlockingRecv error: recv got EOF from 127.12.177.130:55431 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:02 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:02.984602 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:02.978177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:57069)
0806 18:40:02.978504 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:02.978519 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:02.978613 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:02.978951 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:02.978954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:02.979171 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:02.979319 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.979331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.980276 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.980279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.980902 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:02.980912 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.981529 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.981537 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:02.981737 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.982320 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:02.982332 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:02.984465 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":128,"threads_started":1}
W20260806 18:40:02.984798 26937 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:02.978391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:57069 (local address 127.12.177.190:46135)
0806 18:40:02.978568 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:02.978572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:02.978588 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:40:02.978731 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:02.978733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:02.978789 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:02.978895 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:02.979454 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.980159 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.981032 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:02.981277 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:02.981470 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:02.984653 (+ 3183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:57069: BlockingRecv error: recv got EOF from 127.12.177.131:57069 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:03.535969 26944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:03.529270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:40207)
0806 18:40:03.529897 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:03.529917 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:03.530063 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:03.530350 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:03.530352 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:03.530558 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:03.530662 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.530668 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.531516 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.531520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.532127 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.532137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.532628 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.532630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.532697 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.533268 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:03.533281 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:03.535750 (+ 2469us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":123,"threads_started":1}
W20260806 18:40:03.536173 26946 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:03.529452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:40207 (local address 127.12.177.190:46135)
0806 18:40:03.529713 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:03.529717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:03.530057 (+ 340us) server_negotiation.cc:407] Connection header received
0806 18:40:03.530168 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:03.530170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:03.530223 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:03.530312 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:03.530783 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.531365 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.532272 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.532512 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.532601 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.536043 (+ 3442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:40207: BlockingRecv error: recv got EOF from 127.12.177.129:40207 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":70,"threads_started":1}
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:03.756052 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:03.749917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:55799)
0806 18:40:03.750252 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:03.750275 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:03.750394 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:03.750681 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:03.750684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:03.750888 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:03.751006 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.751013 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.751782 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.751785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.752389 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.752399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.752914 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.752916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.752982 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.753654 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:03.753668 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:03.755918 (+ 2250us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":146,"threads_started":1}
W20260806 18:40:03.756372 26946 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:03.750068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:55799 (local address 127.12.177.190:46135)
0806 18:40:03.750227 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:03.750230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:03.750356 (+ 126us) server_negotiation.cc:407] Connection header received
0806 18:40:03.750480 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:03.750483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:03.750529 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:03.750612 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:03.751124 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.751661 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.752535 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.752763 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.752889 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.756242 (+ 3353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:55799: BlockingRecv error: recv got EOF from 127.12.177.130:55799 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:03 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:03.993221 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:03.985651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:41545)
0806 18:40:03.985948 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:03.985962 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:03.986059 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:03.986504 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:03.986509 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:03.986794 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:03.986953 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.986961 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.988004 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.988007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.988702 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:03.988714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.989267 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.989270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:03.989501 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.990527 (+ 1026us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:03.990543 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:03.993027 (+ 2484us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":105,"threads_started":1}
W20260806 18:40:03.993273 26946 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:03.985817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:41545 (local address 127.12.177.190:46135)
0806 18:40:03.986099 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:03.986103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:03.986121 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:40:03.986166 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:03.986169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:03.986216 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:03.986328 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:03.987151 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.987835 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.988858 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:03.989098 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:03.989196 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:03.993166 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:41545: BlockingRecv error: recv got EOF from 127.12.177.131:41545 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:04.543831 26950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:04.536915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:44697)
0806 18:40:04.537334 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:04.537371 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:04.537502 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:04.537819 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:04.537822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:04.538078 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:04.538184 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.538190 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.539053 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.539057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.539724 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.539735 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.540246 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.540250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.540341 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:04.541067 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:04.541080 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:04.543625 (+ 2545us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":93,"threads_started":1}
W20260806 18:40:04.543938 26953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:04.537070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:44697 (local address 127.12.177.190:46135)
0806 18:40:04.537397 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:04.537404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:04.537428 (+ 24us) server_negotiation.cc:407] Connection header received
0806 18:40:04.537617 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:04.537621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:04.537681 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:04.537787 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:04.538316 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.538919 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.539865 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.540117 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.540234 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:04.543784 (+ 3550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:44697: BlockingRecv error: recv got EOF from 127.12.177.129:44697 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":77,"threads_started":1}
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:04.763659 26956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:04.756957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:45317)
0806 18:40:04.757309 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:04.757327 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:04.757477 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:04.757788 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:04.757790 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:04.758000 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:04.758104 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.758109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.758978 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.758981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.759682 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.759694 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.760332 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.760335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.760408 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:04.760986 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:04.760999 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:04.763519 (+ 2520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":126,"threads_started":1}
W20260806 18:40:04.764125 26953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:04.757065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45317 (local address 127.12.177.190:46135)
0806 18:40:04.757254 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:04.757258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:04.757436 (+ 178us) server_negotiation.cc:407] Connection header received
0806 18:40:04.757588 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:04.757591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:04.757649 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:04.757742 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:04.758252 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.758818 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.759862 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.760117 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.760215 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:04.763988 (+ 3773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:45317: BlockingRecv error: recv got EOF from 127.12.177.130:45317 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:04 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:05.004078 26957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:04.994277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:37313)
0806 18:40:04.994580 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:04.994597 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:04.994750 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:04.995051 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:04.995055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:04.995290 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:04.995397 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.995403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.996183 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.996188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.996775 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:04.996783 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.997300 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.997304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:04.997435 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.001753 (+ 4318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:05.001771 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:05.003889 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":110,"threads_started":1}
W20260806 18:40:05.004230 26953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:04.994343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:37313 (local address 127.12.177.190:46135)
0806 18:40:04.994501 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:04.994506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:04.994686 (+ 180us) server_negotiation.cc:407] Connection header received
0806 18:40:04.994870 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:04.994873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:04.994931 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:04.995028 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:04.995522 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.996065 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.996911 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:04.997145 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:04.997264 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.004099 (+ 6835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:37313: BlockingRecv error: recv got EOF from 127.12.177.131:37313 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 18:40:05 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:05 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:05.551394 26958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:05.545071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:54845)
0806 18:40:05.545484 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:05.545499 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:05.545608 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:05.545898 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:05.545900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:05.546106 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:05.546214 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:05.546220 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.546998 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.547001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:05.547612 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:05.547622 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.548099 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.548101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:05.548170 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.548802 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:05.548815 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:05.551205 (+ 2390us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
W20260806 18:40:05.551510 26959 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:05.545136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:54845 (local address 127.12.177.190:46135)
0806 18:40:05.545534 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:05.545538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:05.545559 (+ 21us) server_negotiation.cc:407] Connection header received
0806 18:40:05.545720 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:05.545722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:05.545769 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:05.545856 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:05.546325 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.546888 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.547740 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.547982 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.548068 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.551363 (+ 3295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:54845: BlockingRecv error: recv got EOF from 127.12.177.129:54845 (error 108)
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":69,"threads_started":1}
Aug 06 18:40:05 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:05 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:05.770910 26961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:05.764806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:53251)
0806 18:40:05.765165 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:05.765183 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:05.765379 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:05.765678 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:05.765681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:05.765965 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:05.766070 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:05.766076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.766901 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.766906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:05.767470 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:05.767479 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.767992 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.767996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:05.768093 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.768656 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:05.768669 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:05.770721 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":104,"threads_started":1}
W20260806 18:40:05.770967 26959 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:05.764919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:53251 (local address 127.12.177.190:46135)
0806 18:40:05.765146 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:05.765151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:05.765280 (+ 129us) server_negotiation.cc:407] Connection header received
0806 18:40:05.765493 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:05.765496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:05.765551 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:05.765649 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:05.766199 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.766768 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.767599 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:05.767832 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:05.767955 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:05.770856 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:53251: BlockingRecv error: recv got EOF from 127.12.177.130:53251 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.131@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:06.011922 26962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:06.005224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.131:52609)
0806 18:40:06.005734 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:06.005751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:06.005932 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:06.006254 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:06.006258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:06.006537 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:06.006638 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.006644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.007504 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.007508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.008133 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.008142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.008694 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.008699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.008792 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.009472 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:06.009486 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:06.011727 (+ 2241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":109,"threads_started":1}
W20260806 18:40:06.012043 26959 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:06.005468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:52609 (local address 127.12.177.190:46135)
0806 18:40:06.005695 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:06.005700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:06.005854 (+ 154us) server_negotiation.cc:407] Connection header received
0806 18:40:06.006073 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:06.006077 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:06.006129 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:06.006228 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:06.006776 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.007377 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.008269 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.008530 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.008655 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.011920 (+ 3265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.131:52609: BlockingRecv error: recv got EOF from 127.12.177.131:52609 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.129@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:06.559262 26963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:06.552671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.129:36739)
0806 18:40:06.553028 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:06.553047 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:06.553173 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:06.553798 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:06.553802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:06.554058 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:06.554166 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.554173 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.555155 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.555158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.555740 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.555749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.556315 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.556318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.556409 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.557025 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:06.557038 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:06.559131 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":107,"threads_started":1}
W20260806 18:40:06.559461 26966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:06.552830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:36739 (local address 127.12.177.190:46135)
0806 18:40:06.553096 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:06.553102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:06.553120 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:40:06.553543 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:06.553547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:06.553602 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:06.553720 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:06.554325 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.555046 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.555925 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.556169 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.556267 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.559304 (+ 3037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.129:36739: BlockingRecv error: recv got EOF from 127.12.177.129:36739 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":73,"threads_started":1}
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 18:40:06 dist-test-slave-j2vl krb5kdc[25352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.177.130@KRBTEST.COM for oryx/127.12.177.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 18:40:06.777804 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:06.772050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:46135 (local address 127.12.177.130:35951)
0806 18:40:06.772345 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:06.772360 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:06.772458 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:06.772767 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:06.772770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:06.772981 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:06.773079 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.773085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.773962 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.773965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.774510 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:06.774519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.774984 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.774987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:06.775049 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.775526 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:06.775539 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:06.777677 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.177.190:46135: Server oryx/127.12.177.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":98,"threads_started":1}
W20260806 18:40:06.778112 26966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:06.772130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:35951 (local address 127.12.177.190:46135)
0806 18:40:06.772295 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:06.772301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:06.772438 (+ 137us) server_negotiation.cc:407] Connection header received
0806 18:40:06.772539 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:06.772541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:06.772594 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:06.772664 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:06.773193 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.773785 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.774617 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:06.774861 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:06.774941 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:06.777841 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.177.130:35951: BlockingRecv error: recv got EOF from 127.12.177.130:35951 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 18:40:06.863000 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 26245
I20260806 18:40:06.882390 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 26478
I20260806 18:40:06.900626 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 26680
I20260806 18:40:06.914816 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 26136
2026-08-06T18:40:06Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18639 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T18:40:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:40:06Z Disabled control of system clock
I20260806 18:40:06.958742 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:39837
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:38761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:39837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 18:40:07.085925 26975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:07.086257 26975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:07.086295 26975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:07.090653 26975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:40:07.090740 26975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:07.090755 26975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:07.090773 26975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:40:07.090799 26975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:40:07.096233 26975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:39837
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:39837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:07.097581 26975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:07.099146 26975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:07.109248 26980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.109248 26981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.109361 26975 server_base.cc:1034] running on GCE node
W20260806 18:40:07.109292 26985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.110461 26975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:07.111931 26975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:07.113133 26975 hybrid_clock.cc:648] HybridClock initialized: now 1786041607113077 us; error 74 us; skew 500 ppm
I20260806 18:40:07.115649 26975 webserver.cc:460] Webserver started at http://127.12.177.190:46091/ using document root <none> and password file <none>
I20260806 18:40:07.116292 26975 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:07.116364 26975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:07.116551 26975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:07.119099 26975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "7d76608cf37c1d537b41e27dd3317484"
server_key_iv: "e7b6bf8f7b5ae13a674d781705890754"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.119784 26975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "7d76608cf37c1d537b41e27dd3317484"
server_key_iv: "e7b6bf8f7b5ae13a674d781705890754"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.123970 26975 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:40:07.126804 26992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.128341 26975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:40:07.128484 26975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "7d76608cf37c1d537b41e27dd3317484"
server_key_iv: "e7b6bf8f7b5ae13a674d781705890754"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.128593 26975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:07.150655 26975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:07.151470 26975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:07.151644 26975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:07.159845 26975 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:39837
I20260806 18:40:07.159963 27070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:39837 every 8 connection(s)
I20260806 18:40:07.160979 26975 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:40:07.164580 27071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:07.166905 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 26975
I20260806 18:40:07.167047 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:40:07.167356 12998 external_mini_cluster.cc:1428] Setting key 575c4aa6d9563779516bc857f91b5eae
I20260806 18:40:07.171871 27071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba: Bootstrap starting.
I20260806 18:40:07.174779 27071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:07.175653 27071 log.cc:824] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:07.178712 27071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba: No bootstrap required, opened a new log
I20260806 18:40:07.178885 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.169129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40090 (local address 127.12.177.190:39837)
0806 18:40:07.169994 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:07.170013 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:07.170055 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:40:07.170866 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:07.170888 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:07.171389 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:07.171890 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:07.172425 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.173568 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.174540 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.175163 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.175361 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.176368 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:07.176375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:07.176391 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:07.176942 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:07.177034 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:07.177068 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:07.177183 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:07.177384 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 18:40:07.177699 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":190,"threads_started":1}
I20260806 18:40:07.183111 27071 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } }
I20260806 18:40:07.183384 27071 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:07.183422 27071 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b20e3f0ed7499ba0559d1e3faaaaba, State: Initialized, Role: FOLLOWER
I20260806 18:40:07.183832 27071 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } }
I20260806 18:40:07.183959 27071 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:40:07.184002 27071 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:40:07.184072 27071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:07.185144 27071 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } }
I20260806 18:40:07.185561 27071 leader_election.cc:302] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0b20e3f0ed7499ba0559d1e3faaaaba; no voters:
I20260806 18:40:07.185889 27071 leader_election.cc:288] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:40:07.186043 27076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:40:07.186321 27076 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [term 1 LEADER]: Becoming Leader. State: Replica: a0b20e3f0ed7499ba0559d1e3faaaaba, State: Running, Role: LEADER
I20260806 18:40:07.186800 27076 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } }
I20260806 18:40:07.187310 27071 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:40:07.188951 27078 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0b20e3f0ed7499ba0559d1e3faaaaba. Latest consensus state: current_term: 1 leader_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } } }
I20260806 18:40:07.189003 27077 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b20e3f0ed7499ba0559d1e3faaaaba" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39837 } } }
I20260806 18:40:07.189102 27078 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:07.189133 27077 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:07.189541 27092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:40:07.193459 27092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:40:07.200042 27092 catalog_manager.cc:1347] Generated new cluster ID: 5b6c105fa39c45cc8e87b8e5d354d2d5
I20260806 18:40:07.200146 27092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:40:07.222479 27092 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:40:07.223517 27092 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:40:07.230268 27092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0b20e3f0ed7499ba0559d1e3faaaaba: Generated new TSK 0
I20260806 18:40:07.231115 27092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:40:07.240293 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--builtin_ntp_servers=127.12.177.148:38761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 18:40:07.376514 27103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:07.376827 27103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:07.376868 27103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:07.381209 27103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:07.381287 27103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:07.381397 27103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:40:07.386416 27103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:07.387580 27103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:07.389266 27103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:07.399794 27111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.399798 27114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.399798 27110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.400110 27103 server_base.cc:1034] running on GCE node
I20260806 18:40:07.400707 27103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:07.401520 27103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:07.402721 27103 hybrid_clock.cc:648] HybridClock initialized: now 1786041607402703 us; error 35 us; skew 500 ppm
I20260806 18:40:07.404965 27103 webserver.cc:460] Webserver started at http://127.12.177.129:39767/ using document root <none> and password file <none>
I20260806 18:40:07.405709 27103 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:07.405817 27103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:07.406081 27103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:07.408496 27103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "f61cb001eb334f5b8c4c92b2aaafaadb"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "5dc6ac27c97132dc4c31d6b2482a1852"
server_key_iv: "ed159e9d5308e9e91494175506fe22d6"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.409152 27103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "f61cb001eb334f5b8c4c92b2aaafaadb"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "5dc6ac27c97132dc4c31d6b2482a1852"
server_key_iv: "ed159e9d5308e9e91494175506fe22d6"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.413892 27103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:40:07.416940 27122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.418478 27103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:07.418659 27103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "f61cb001eb334f5b8c4c92b2aaafaadb"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "5dc6ac27c97132dc4c31d6b2482a1852"
server_key_iv: "ed159e9d5308e9e91494175506fe22d6"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.418812 27103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:07.451887 27103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:07.452724 27103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:07.452960 27103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:07.453708 27103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:07.454787 27103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:07.454862 27103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.454945 27103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:07.454990 27103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.465559 27103 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37911
I20260806 18:40:07.465580 27287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37911 every 8 connection(s)
I20260806 18:40:07.466689 27103 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:40:07.470613 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 27103
I20260806 18:40:07.470745 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:40:07.471071 12998 external_mini_cluster.cc:1428] Setting key 77ec860de35b18f6661bfc9862003278
I20260806 18:40:07.473387 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--builtin_ntp_servers=127.12.177.148:38761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 18:40:07.477248 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.468803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:53845 (local address 127.12.177.190:39837)
0806 18:40:07.468987 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:07.468992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:07.470290 (+ 1298us) server_negotiation.cc:407] Connection header received
0806 18:40:07.471903 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:07.471907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:07.471969 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:07.472084 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:07.473107 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.473819 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.475070 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.475312 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.475427 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.476703 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:07.476707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:07.476709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:07.476728 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:07.476754 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:07.476762 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:07.476845 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:07.477018 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 18:40:07.477092 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:40:07.478291 27293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.469281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39837 (local address 127.12.177.129:53845)
0806 18:40:07.470118 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:07.470170 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:07.471647 (+ 1477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:07.472283 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:07.472291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:07.472393 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:07.472938 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.472952 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.473966 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.473969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.474932 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.474943 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.475500 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.475506 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.475692 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.476398 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:07.476400 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:07.476449 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:07.476525 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:07.476849 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:07.476863 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:07.476870 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:40:07.477019 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 18:40:07.477400 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":136,"threads_started":1}
I20260806 18:40:07.479960 27288 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39837
I20260806 18:40:07.480265 27288 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:07.480892 27288 heartbeater.cc:511] Master 127.12.177.190:39837 requested a full tablet report, sending...
I20260806 18:40:07.482933 27012 ts_manager.cc:194] Registered new tserver with Master: f61cb001eb334f5b8c4c92b2aaafaadb (127.12.177.129:37911)
I20260806 18:40:07.484846 27012 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.129:53845
W20260806 18:40:07.604321 27294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:07.604666 27294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:07.604709 27294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:07.609618 27294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:07.609714 27294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:07.609777 27294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:40:07.614972 27294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:07.616282 27294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:07.618511 27294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:07.630520 27303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.630677 27294 server_base.cc:1034] running on GCE node
W20260806 18:40:07.630520 27306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.630887 27312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.631414 27294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:07.632207 27294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:07.633441 27294 hybrid_clock.cc:648] HybridClock initialized: now 1786041607633421 us; error 37 us; skew 500 ppm
I20260806 18:40:07.635684 27294 webserver.cc:460] Webserver started at http://127.12.177.130:40397/ using document root <none> and password file <none>
I20260806 18:40:07.636366 27294 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:07.636444 27294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:07.636684 27294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:07.639045 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "307bbd147e794bbd88c7f6cecb7a3214"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "d5d28216671564fbc2fbfdd3b0e64574"
server_key_iv: "784481d3517a0b83076c76f1338457ae"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.639747 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "307bbd147e794bbd88c7f6cecb7a3214"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "d5d28216671564fbc2fbfdd3b0e64574"
server_key_iv: "784481d3517a0b83076c76f1338457ae"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.643914 27294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:40:07.647054 27325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.648624 27294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:40:07.648744 27294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "307bbd147e794bbd88c7f6cecb7a3214"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "d5d28216671564fbc2fbfdd3b0e64574"
server_key_iv: "784481d3517a0b83076c76f1338457ae"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.648932 27294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:07.671070 27294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:07.671909 27294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:07.672156 27294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:07.672816 27294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:07.673861 27294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:07.673910 27294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.673954 27294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:07.673969 27294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.684248 27294 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:41105
I20260806 18:40:07.684321 27517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:41105 every 8 connection(s)
I20260806 18:40:07.685523 27294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:40:07.692721 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 27294
I20260806 18:40:07.692874 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:40:07.693178 12998 external_mini_cluster.cc:1428] Setting key fff8a83c4d3f4ed1e8d1d7f99acc6f5e
I20260806 18:40:07.695463 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--builtin_ntp_servers=127.12.177.148:38761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 18:40:07.697094 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.687865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:46847 (local address 127.12.177.190:39837)
0806 18:40:07.688027 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:07.688031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:07.689488 (+ 1457us) server_negotiation.cc:407] Connection header received
0806 18:40:07.691157 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:07.691161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:07.691220 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:07.691318 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:07.692478 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.693291 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.694833 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.695057 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.695178 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.696536 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:07.696539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:07.696542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:07.696555 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:07.696577 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:07.696584 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:07.696682 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:07.696868 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 18:40:07.696941 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:40:07.698511 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.688342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39837 (local address 127.12.177.130:46847)
0806 18:40:07.689236 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:07.689331 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:07.690911 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:07.691545 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:07.691554 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:07.691651 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:07.692246 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.692261 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.693472 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.693476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.694640 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.694655 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.695250 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.695258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.695445 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.696205 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:07.696207 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:07.696256 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:07.696342 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:07.696699 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:07.696717 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:07.696723 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 18:40:07.696870 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 18:40:07.697226 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":200,"threads_started":1}
I20260806 18:40:07.699867 27518 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39837
I20260806 18:40:07.700170 27518 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:07.700796 27518 heartbeater.cc:511] Master 127.12.177.190:39837 requested a full tablet report, sending...
I20260806 18:40:07.702150 27012 ts_manager.cc:194] Registered new tserver with Master: 307bbd147e794bbd88c7f6cecb7a3214 (127.12.177.130:41105)
I20260806 18:40:07.703102 27012 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.130:46847
W20260806 18:40:07.820045 27523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:07.820381 27523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:07.820422 27523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:07.824782 27523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:07.824862 27523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:07.824920 27523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:40:07.830341 27523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:07.831518 27523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:07.833048 27523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:40:07.844525 27523 server_base.cc:1034] running on GCE node
W20260806 18:40:07.844449 27532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.844467 27530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:07.844451 27534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:07.845271 27523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:07.846110 27523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:07.847352 27523 hybrid_clock.cc:648] HybridClock initialized: now 1786041607847328 us; error 41 us; skew 500 ppm
I20260806 18:40:07.849622 27523 webserver.cc:460] Webserver started at http://127.12.177.131:46155/ using document root <none> and password file <none>
I20260806 18:40:07.850255 27523 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:07.850327 27523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:07.850519 27523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:07.852852 27523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "100e1157cfe24861b1113834c838dd25"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "11c7938141191a5fcdeaefbbebcf99c6"
server_key_iv: "858addb70efc69e493cc88768d7b5e82"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.853557 27523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "100e1157cfe24861b1113834c838dd25"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "11c7938141191a5fcdeaefbbebcf99c6"
server_key_iv: "858addb70efc69e493cc88768d7b5e82"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.857998 27523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:40:07.861168 27542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.862746 27523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:07.862972 27523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "100e1157cfe24861b1113834c838dd25"
format_stamp: "Formatted at 2026-08-06 18:40:07 on dist-test-slave-j2vl"
server_key: "11c7938141191a5fcdeaefbbebcf99c6"
server_key_iv: "858addb70efc69e493cc88768d7b5e82"
server_key_version: "encryptionkey@0"
I20260806 18:40:07.863103 27523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:07.882016 27523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:07.882839 27523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:07.883061 27523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:07.883737 27523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:07.884829 27523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:07.884879 27523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.884960 27523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:07.885000 27523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:07.895722 27523 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:38713
I20260806 18:40:07.895744 27710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:38713 every 8 connection(s)
I20260806 18:40:07.896763 27523 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:40:07.905570 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 27523
I20260806 18:40:07.905721 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:40:07.906054 12998 external_mini_cluster.cc:1428] Setting key 3bedb9ab6b333075e7c0c591c1e5b3ec
I20260806 18:40:07.906603 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.898821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:47725 (local address 127.12.177.190:39837)
0806 18:40:07.898970 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:07.898974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:07.900070 (+ 1096us) server_negotiation.cc:407] Connection header received
0806 18:40:07.901590 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:07.901594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:07.901657 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:07.901770 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:07.902721 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.903268 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.904449 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.904684 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.904802 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.906077 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:07.906081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:07.906084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:07.906099 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:07.906127 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:07.906156 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:07.906227 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:07.906391 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 18:40:07.906460 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:40:07.907740 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:07.899167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39837 (local address 127.12.177.131:47725)
0806 18:40:07.899911 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:07.899955 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:07.901309 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:07.901964 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:07.901971 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:07.902059 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:07.902572 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.902586 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.903412 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.903420 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.904315 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:07.904324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:07.904874 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:07.904882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:07.905045 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:07.905763 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:07.905765 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:07.905821 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:07.905914 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:07.906229 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:07.906241 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:07.906248 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:40:07.906392 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 18:40:07.906706 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":120,"threads_started":1}
I20260806 18:40:07.908861 27711 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39837
I20260806 18:40:07.909087 27711 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:07.909648 27711 heartbeater.cc:511] Master 127.12.177.190:39837 requested a full tablet report, sending...
I20260806 18:40:07.910662 27012 ts_manager.cc:194] Registered new tserver with Master: 100e1157cfe24861b1113834c838dd25 (127.12.177.131:38713)
I20260806 18:40:07.911270 27012 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.131:47725
I20260806 18:40:07.920594 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 18:40:07.924513 27074 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:07.923024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.12.177.190:39837)
0806 18:40:07.923166 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:07.923170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:07.923344 (+ 174us) server_negotiation.cc:407] Connection header received
0806 18:40:07.923490 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:07.923494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:07.923554 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:07.923645 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:07.924060 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40094: BlockingRecv error: recv got EOF from 127.0.0.1:40094 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:40:07.924624 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 27103
I20260806 18:40:07.942911 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 27294
I20260806 18:40:07.953276 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 27523
I20260806 18:40:07.976795 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 26975
2026-08-06T18:40:07Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1058 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T18:40:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:40:08Z Disabled control of system clock
I20260806 18:40:08.018203 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:41777
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:41777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 18:40:08.144243 27724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:08.144532 27724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:08.144572 27724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:08.148828 27724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:40:08.148911 27724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:08.148926 27724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:08.148944 27724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:40:08.148960 27724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:40:08.154054 27724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:41777
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:41777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:08.155274 27724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:08.156793 27724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:08.166599 27736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.166601 27737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:08.166746 27724 server_base.cc:1034] running on GCE node
W20260806 18:40:08.166610 27740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:08.167665 27724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:08.169064 27724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:08.170327 27724 hybrid_clock.cc:648] HybridClock initialized: now 1786041608170302 us; error 45 us; skew 500 ppm
I20260806 18:40:08.172596 27724 webserver.cc:460] Webserver started at http://127.12.177.190:32897/ using document root <none> and password file <none>
I20260806 18:40:08.173295 27724 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:08.173437 27724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:08.173702 27724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:08.176054 27724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "6abc249d38df4d339a5c5982580099c9"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "5ea1b90665b0bd5b68610625cc7cd205"
server_key_iv: "7f41470f2b31a7623b56a484e02878fa"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.176818 27724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "6abc249d38df4d339a5c5982580099c9"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "5ea1b90665b0bd5b68610625cc7cd205"
server_key_iv: "7f41470f2b31a7623b56a484e02878fa"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.181166 27724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260806 18:40:08.184290 27750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.185894 27724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:08.186076 27724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "6abc249d38df4d339a5c5982580099c9"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "5ea1b90665b0bd5b68610625cc7cd205"
server_key_iv: "7f41470f2b31a7623b56a484e02878fa"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.186228 27724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:08.191633 27724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:08.192421 27724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:08.192647 27724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:08.200893 27825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:41777 every 8 connection(s)
I20260806 18:40:08.200889 27724 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:41777
I20260806 18:40:08.202227 27724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:40:08.206312 27826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:08.206616 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 27724
I20260806 18:40:08.206765 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:40:08.207101 12998 external_mini_cluster.cc:1428] Setting key 748b932c4f9a9771424b2c0fe656f82f
I20260806 18:40:08.214483 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.208814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59556 (local address 127.12.177.190:41777)
0806 18:40:08.209652 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:08.209671 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:08.209713 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:40:08.210833 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:08.210858 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:08.211280 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:08.211730 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:08.212859 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:08.212864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:08.212878 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:08.212894 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:08.212994 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:08.213013 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:08.213153 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:08.213292 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 18:40:08.213644 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":156,"threads_started":1}
I20260806 18:40:08.215210 27826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9: Bootstrap starting.
I20260806 18:40:08.218139 27826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:08.219007 27826 log.cc:824] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:08.222084 27826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9: No bootstrap required, opened a new log
I20260806 18:40:08.227319 27826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } }
I20260806 18:40:08.227689 27826 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:08.227766 27826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6abc249d38df4d339a5c5982580099c9, State: Initialized, Role: FOLLOWER
I20260806 18:40:08.228282 27826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } }
I20260806 18:40:08.228472 27826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:40:08.228585 27826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:40:08.228734 27826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:08.230036 27826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } }
I20260806 18:40:08.230481 27826 leader_election.cc:302] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6abc249d38df4d339a5c5982580099c9; no voters:
I20260806 18:40:08.230903 27826 leader_election.cc:288] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:40:08.231169 27832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:40:08.231597 27832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [term 1 LEADER]: Becoming Leader. State: Replica: 6abc249d38df4d339a5c5982580099c9, State: Running, Role: LEADER
I20260806 18:40:08.232038 27832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } }
I20260806 18:40:08.232745 27826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:40:08.234285 27833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6abc249d38df4d339a5c5982580099c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } } }
I20260806 18:40:08.234421 27834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6abc249d38df4d339a5c5982580099c9. Latest consensus state: current_term: 1 leader_uuid: "6abc249d38df4d339a5c5982580099c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc249d38df4d339a5c5982580099c9" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41777 } } }
I20260806 18:40:08.234529 27833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:08.234550 27834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9 [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:08.235548 27845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:40:08.239620 27845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:40:08.246881 27845 catalog_manager.cc:1347] Generated new cluster ID: 1e53d443da5945a197dad5b0de0bf49e
I20260806 18:40:08.246991 27845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:40:08.261360 27845 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:40:08.261816 27845 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:40:08.271552 27845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6abc249d38df4d339a5c5982580099c9: Generated new TSK 0
I20260806 18:40:08.272526 27845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:40:08.282773 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--builtin_ntp_servers=127.12.177.148:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 18:40:08.410213 27860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:08.410597 27860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:08.410696 27860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:08.415117 27860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:08.415241 27860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:08.415349 27860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:40:08.420516 27860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:08.421844 27860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:08.423354 27860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:08.433710 27870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.433830 27874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.433809 27871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:08.434170 27860 server_base.cc:1034] running on GCE node
I20260806 18:40:08.434679 27860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:08.435390 27860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:08.436568 27860 hybrid_clock.cc:648] HybridClock initialized: now 1786041608436549 us; error 37 us; skew 500 ppm
I20260806 18:40:08.438786 27860 webserver.cc:460] Webserver started at http://127.12.177.129:45131/ using document root <none> and password file <none>
I20260806 18:40:08.439451 27860 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:08.439522 27860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:08.439755 27860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:08.442152 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "268b396078a647dba62bfb063b68bc8d"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "e41ec62052f036480435c6223e91be98"
server_key_iv: "b83490174bfd01f3b6da6fd2634034da"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.442790 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "268b396078a647dba62bfb063b68bc8d"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "e41ec62052f036480435c6223e91be98"
server_key_iv: "b83490174bfd01f3b6da6fd2634034da"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.446995 27860 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:40:08.450008 27882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.451506 27860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:08.451668 27860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "268b396078a647dba62bfb063b68bc8d"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "e41ec62052f036480435c6223e91be98"
server_key_iv: "b83490174bfd01f3b6da6fd2634034da"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.451808 27860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:08.456967 27860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:08.457784 27860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:08.457994 27860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:08.458599 27860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:08.459710 27860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:08.459784 27860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.459857 27860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:08.459889 27860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.471822 27860 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:33965
I20260806 18:40:08.471915 28053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:33965 every 8 connection(s)
I20260806 18:40:08.473068 27860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:40:08.480091 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.475294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:44903 (local address 127.12.177.190:41777)
0806 18:40:08.475457 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:08.475461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:08.476627 (+ 1166us) server_negotiation.cc:407] Connection header received
0806 18:40:08.478182 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:08.478186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:08.478235 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:08.478325 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:08.479588 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:08.479592 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:08.479594 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:08.479608 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:08.479630 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:08.479640 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:08.479756 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:08.479917 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 18:40:08.479965 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 18:40:08.481469 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.475743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41777 (local address 127.12.177.129:44903)
0806 18:40:08.476472 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:08.476517 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:08.477930 (+ 1413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:08.478531 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:08.478538 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:08.478642 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:08.479264 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:08.479265 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:08.479327 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:08.479407 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:08.479730 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:08.479738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:08.479743 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 18:40:08.479955 (+ 212us) client_negotiation.cc:240] Negotiation successful
0806 18:40:08.480229 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":131,"threads_started":1}
I20260806 18:40:08.481623 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 27860
I20260806 18:40:08.481739 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:40:08.482097 12998 external_mini_cluster.cc:1428] Setting key ce34ec0a78da1c622e1fec0814bb94b2
I20260806 18:40:08.483114 28054 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41777
I20260806 18:40:08.483440 28054 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:08.484067 28054 heartbeater.cc:511] Master 127.12.177.190:41777 requested a full tablet report, sending...
I20260806 18:40:08.484469 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--builtin_ntp_servers=127.12.177.148:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 18:40:08.486181 27775 ts_manager.cc:194] Registered new tserver with Master: 268b396078a647dba62bfb063b68bc8d (127.12.177.129:33965)
W20260806 18:40:08.612814 28061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:08.613193 28061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:08.613281 28061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:08.617743 28061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:08.617851 28061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:08.617949 28061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:40:08.623203 28061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:08.624495 28061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:08.626032 28061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:40:08.636899 28061 server_base.cc:1034] running on GCE node
W20260806 18:40:08.636860 28070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.636798 28073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.636806 28068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:08.637532 28061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:08.638263 28061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:08.639443 28061 hybrid_clock.cc:648] HybridClock initialized: now 1786041608639423 us; error 34 us; skew 500 ppm
I20260806 18:40:08.641448 28061 webserver.cc:460] Webserver started at http://127.12.177.130:34539/ using document root <none> and password file <none>
I20260806 18:40:08.642130 28061 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:08.642201 28061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:08.642434 28061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:08.644656 28061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "b7a0144ba6e0487d85529e7c7e97cceb"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "a00ea0845d51703cc133114605e29c1d"
server_key_iv: "67b3ed79f840debe9b6e28bc05bf8ff6"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.645289 28061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "b7a0144ba6e0487d85529e7c7e97cceb"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "a00ea0845d51703cc133114605e29c1d"
server_key_iv: "67b3ed79f840debe9b6e28bc05bf8ff6"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.649632 28061 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:40:08.652580 28082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.654078 28061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:08.654233 28061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "b7a0144ba6e0487d85529e7c7e97cceb"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "a00ea0845d51703cc133114605e29c1d"
server_key_iv: "67b3ed79f840debe9b6e28bc05bf8ff6"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.654387 28061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:08.659641 28061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:08.660439 28061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:08.660647 28061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:08.661250 28061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:08.662330 28061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:08.662408 28061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.662478 28061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:08.662529 28061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.672276 28061 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:42751
I20260806 18:40:08.672313 28253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:42751 every 8 connection(s)
I20260806 18:40:08.673292 28061 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:40:08.680302 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.675392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:38537 (local address 127.12.177.190:41777)
0806 18:40:08.675564 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:08.675569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:08.676840 (+ 1271us) server_negotiation.cc:407] Connection header received
0806 18:40:08.678333 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:08.678336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:08.678382 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:08.678467 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:08.679720 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:08.679724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:08.679726 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:08.679740 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:08.679761 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:08.679770 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:08.679921 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:08.680122 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 18:40:08.680174 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 18:40:08.681279 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.675886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41777 (local address 127.12.177.130:38537)
0806 18:40:08.676669 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:08.676713 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:08.678080 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:08.678662 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:08.678669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:08.678768 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:08.679419 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:08.679421 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:08.679466 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:08.679542 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:08.679910 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:08.679920 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:08.679925 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 18:40:08.680096 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 18:40:08.680335 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":130,"threads_started":1}
I20260806 18:40:08.682782 28254 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41777
I20260806 18:40:08.683077 28254 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:08.683624 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 28061
I20260806 18:40:08.683771 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:40:08.683753 28254 heartbeater.cc:511] Master 127.12.177.190:41777 requested a full tablet report, sending...
I20260806 18:40:08.684144 12998 external_mini_cluster.cc:1428] Setting key 8a248aae777b5a16eb193b6c2fc8b637
I20260806 18:40:08.685210 27775 ts_manager.cc:194] Registered new tserver with Master: b7a0144ba6e0487d85529e7c7e97cceb (127.12.177.130:42751)
I20260806 18:40:08.686887 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--builtin_ntp_servers=127.12.177.148:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 18:40:08.815763 28258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:08.816115 28258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:08.816165 28258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:08.820750 28258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:08.820854 28258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:08.820924 28258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:40:08.826376 28258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:08.827685 28258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:08.829492 28258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:08.840600 28263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.840889 28264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:08.840917 28268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:08.841060 28258 server_base.cc:1034] running on GCE node
I20260806 18:40:08.841621 28258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:08.842389 28258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:08.843608 28258 hybrid_clock.cc:648] HybridClock initialized: now 1786041608843591 us; error 40 us; skew 500 ppm
I20260806 18:40:08.846125 28258 webserver.cc:460] Webserver started at http://127.12.177.131:45711/ using document root <none> and password file <none>
I20260806 18:40:08.846809 28258 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:08.846916 28258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:08.847319 28258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:08.849781 28258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "16fb2da3366f4c7e89936d88a573f0fd"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "f8a6cbd80de36de384570293d7ad1a24"
server_key_iv: "503b74cd78aba4d4edaaba6087458099"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.850440 28258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "16fb2da3366f4c7e89936d88a573f0fd"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "f8a6cbd80de36de384570293d7ad1a24"
server_key_iv: "503b74cd78aba4d4edaaba6087458099"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.854900 28258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:40:08.858155 28275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.859650 28258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:40:08.859802 28258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "16fb2da3366f4c7e89936d88a573f0fd"
format_stamp: "Formatted at 2026-08-06 18:40:08 on dist-test-slave-j2vl"
server_key: "f8a6cbd80de36de384570293d7ad1a24"
server_key_iv: "503b74cd78aba4d4edaaba6087458099"
server_key_version: "encryptionkey@0"
I20260806 18:40:08.859942 28258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:08.865291 28258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:08.866150 28258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:08.866370 28258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:08.867028 28258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:08.868072 28258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:08.868121 28258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.868188 28258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:08.868222 28258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:08.878537 28258 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:38481
I20260806 18:40:08.878558 28438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:38481 every 8 connection(s)
I20260806 18:40:08.879627 28258 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:40:08.886760 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 28258
I20260806 18:40:08.886940 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:40:08.887189 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.881866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:38691 (local address 127.12.177.190:41777)
0806 18:40:08.882078 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:08.882082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:08.883322 (+ 1240us) server_negotiation.cc:407] Connection header received
0806 18:40:08.884904 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:08.884907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:08.884960 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:08.885045 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:08.886610 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:08.886614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:08.886616 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:40:08.886630 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:08.886652 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:40:08.886661 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:08.886764 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:08.887002 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 18:40:08.887069 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260806 18:40:08.887271 12998 external_mini_cluster.cc:1428] Setting key d28ce1f227c947c9ae7d28b9fd87300e
I20260806 18:40:08.888355 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:08.882296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41777 (local address 127.12.177.131:38691)
0806 18:40:08.883142 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:08.883190 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:08.884579 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:08.885290 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:08.885299 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:08.885581 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:08.886204 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:40:08.886206 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:08.886252 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:40:08.886355 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:08.886770 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:08.886783 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:08.886792 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 18:40:08.887013 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 18:40:08.887330 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":123,"threads_started":1}
I20260806 18:40:08.889603 28439 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41777
I20260806 18:40:08.889937 28439 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:08.890453 28439 heartbeater.cc:511] Master 127.12.177.190:41777 requested a full tablet report, sending...
I20260806 18:40:08.892011 27772 ts_manager.cc:194] Registered new tserver with Master: 16fb2da3366f4c7e89936d88a573f0fd (127.12.177.131:38481)
I20260806 18:40:08.902429 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 18:40:08.905982 27830 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:40:08.904913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59564 (local address 127.12.177.190:41777)
0806 18:40:08.905119 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:08.905123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:08.905201 (+ 78us) server_negotiation.cc:407] Connection header received
0806 18:40:08.905314 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:08.905317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:08.905406 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:08.905496 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:08.905835 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59564: BlockingRecv error: recv got EOF from 127.0.0.1:59564 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 18:40:08.906243 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 27860
I20260806 18:40:08.930163 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 28061
I20260806 18:40:08.945021 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 28258
I20260806 18:40:08.966447 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 27724
2026-08-06T18:40:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (988 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:40:09 dist-test-slave-j2vl krb5kdc[28459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:40:09 dist-test-slave-j2vl krb5kdc[28459](info): set up 2 sockets
Aug 06 18:40:09 dist-test-slave-j2vl krb5kdc[28459](info): commencing operation
krb5kdc: starting...
W20260806 18:40:10.258416 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:40:10 dist-test-slave-j2vl krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:40:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:40:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:40:10.410215 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45227
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:45227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:40:10.535152 28477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:10.535537 28477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:10.535625 28477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:10.540081 28477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:40:10.540211 28477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:10.540249 28477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:10.540292 28477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:40:10.540329 28477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:40:10.546482 28477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:45227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:10.547928 28477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:10.549124 28477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:10.559371 28484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:10.559449 28486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:10.559716 28492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:10.560009 28477 server_base.cc:1034] running on GCE node
I20260806 18:40:10.560788 28477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:10.562217 28477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:10.563463 28477 hybrid_clock.cc:648] HybridClock initialized: now 1786041610563424 us; error 58 us; skew 500 ppm
Aug 06 18:40:10 dist-test-slave-j2vl krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041610, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:40:10.572176 28477 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:40:10.573458 28477 webserver.cc:460] Webserver started at http://127.12.177.190:44261/ using document root <none> and password file <none>
I20260806 18:40:10.574254 28477 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:10.574373 28477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:10.574764 28477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:10.577714 28477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "005f0d180a594eb9b721afce019650a4"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "8281d1999168b314de7115db1a6945fe"
server_key_iv: "31d70e8934161591df5259ec2923e0d3"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.578457 28477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "005f0d180a594eb9b721afce019650a4"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "8281d1999168b314de7115db1a6945fe"
server_key_iv: "31d70e8934161591df5259ec2923e0d3"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.583216 28477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:40:10.586504 28502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:10.588265 28477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:40:10.588495 28477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "005f0d180a594eb9b721afce019650a4"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "8281d1999168b314de7115db1a6945fe"
server_key_iv: "31d70e8934161591df5259ec2923e0d3"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.588667 28477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:10.606115 28477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:10.610417 28477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:10.610687 28477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:10.619800 28477 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:45227
I20260806 18:40:10.620123 28576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:45227 every 8 connection(s)
I20260806 18:40:10.621078 28477 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:40:10.624359 28577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:10.630045 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 28477
I20260806 18:40:10.630249 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:40:10.630550 12998 external_mini_cluster.cc:1428] Setting key a8abfbb3bb42993ef45b3ff130436fd4
I20260806 18:40:10.631243 28577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: Bootstrap starting.
I20260806 18:40:10.634899 28577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:10.635829 28577 log.cc:824] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:10.638504 28577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: No bootstrap required, opened a new log
Aug 06 18:40:10 dist-test-slave-j2vl krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:40:10.642778 28577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } }
I20260806 18:40:10.643137 28577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:10.643232 28577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005f0d180a594eb9b721afce019650a4, State: Initialized, Role: FOLLOWER
I20260806 18:40:10.643823 28577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } }
I20260806 18:40:10.643973 28577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:40:10.644075 28577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:40:10.644222 28577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:10.645838 28577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } }
I20260806 18:40:10.646262 28577 leader_election.cc:302] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005f0d180a594eb9b721afce019650a4; no voters:
I20260806 18:40:10.646662 28577 leader_election.cc:288] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:40:10.647104 28583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:40:10.647330 28583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [term 1 LEADER]: Becoming Leader. State: Replica: 005f0d180a594eb9b721afce019650a4, State: Running, Role: LEADER
I20260806 18:40:10.647694 28583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } }
I20260806 18:40:10.648682 28577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:40:10.648736 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:10.632195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45072 (local address 127.12.177.190:45227)
0806 18:40:10.632745 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:10.632762 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:10.632805 (+ 43us) server_negotiation.cc:407] Connection header received
0806 18:40:10.634049 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:10.634088 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:10.634641 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:10.635092 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:10.636029 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.637610 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.638576 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.639157 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.639350 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:10.642427 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:10.642435 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:10.642453 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:40:10.642488 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:10.644724 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:10.645238 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:10.645245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:10.645252 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:10.645478 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:10.645798 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:10.645801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:10.645803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:10.646365 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:10.646570 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:10.647099 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 18:40:10.647699 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":162,"threads_started":1}
I20260806 18:40:10.649717 28585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005f0d180a594eb9b721afce019650a4. Latest consensus state: current_term: 1 leader_uuid: "005f0d180a594eb9b721afce019650a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } } }
I20260806 18:40:10.650173 28585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:10.650066 28584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "005f0d180a594eb9b721afce019650a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005f0d180a594eb9b721afce019650a4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45227 } } }
I20260806 18:40:10.650535 28584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4 [sys.catalog]: This master's current role is: LEADER
I20260806 18:40:10.651607 28597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:40:10.654533 28597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:40:10.661461 28597 catalog_manager.cc:1347] Generated new cluster ID: 4c997fe3ef6d4c15ac8a89654c446eee
I20260806 18:40:10.661561 28597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:40:10.689330 28597 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:40:10.690722 28597 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:40:10.714730 28597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: Generated new TSK 0
I20260806 18:40:10.715535 28597 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:40:10.766022 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:40:10.904376 28613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:10.904794 28613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:10.904851 28613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:10.909191 28613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:10.909286 28613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:10.909415 28613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:40:10.915462 28613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:10.916740 28613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:10.917914 28613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:10.929301 28626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:10.929553 28619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:10.929636 28620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:10.929764 28613 server_base.cc:1034] running on GCE node
I20260806 18:40:10.930380 28613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:10.931152 28613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:10.932361 28613 hybrid_clock.cc:648] HybridClock initialized: now 1786041610932339 us; error 31 us; skew 500 ppm
Aug 06 18:40:10 dist-test-slave-j2vl krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041610, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:40:10.935539 28613 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:40:10.936463 28613 webserver.cc:460] Webserver started at http://127.12.177.129:34971/ using document root <none> and password file <none>
I20260806 18:40:10.937040 28613 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:10.937107 28613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:10.937299 28613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:10.939639 28613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "afa33b6ff3b943f592882506542e9658"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "f30baab252f6a9760e3f37ffad6769bf"
server_key_iv: "cc38cb39c226fe22e0b0f7f0e08c8a86"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.940237 28613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "afa33b6ff3b943f592882506542e9658"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "f30baab252f6a9760e3f37ffad6769bf"
server_key_iv: "cc38cb39c226fe22e0b0f7f0e08c8a86"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.944753 28613 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 18:40:10.947897 28641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:10.949750 28613 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 18:40:10.949896 28613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "afa33b6ff3b943f592882506542e9658"
format_stamp: "Formatted at 2026-08-06 18:40:10 on dist-test-slave-j2vl"
server_key: "f30baab252f6a9760e3f37ffad6769bf"
server_key_iv: "cc38cb39c226fe22e0b0f7f0e08c8a86"
server_key_version: "encryptionkey@0"
I20260806 18:40:10.950078 28613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:10.971012 28613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:10.975128 28613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:10.975330 28613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:10.975948 28613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:10.976948 28613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:10.977031 28613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:10.977104 28613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:10.977150 28613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:10.987753 28613 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:42645
I20260806 18:40:10.987769 28820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:42645 every 8 connection(s)
I20260806 18:40:10.988874 28613 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:40:10.996680 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 28613
I20260806 18:40:10.996877 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:40:10.997195 12998 external_mini_cluster.cc:1428] Setting key d921809878dc835c24151dd5874d4395
Aug 06 18:40:10 dist-test-slave-j2vl krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041610, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:40:11.007329 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:10.991421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:40717 (local address 127.12.177.190:45227)
0806 18:40:10.991677 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:10.991681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:10.992751 (+ 1070us) server_negotiation.cc:407] Connection header received
0806 18:40:10.994507 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:10.994511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:10.994581 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:10.994755 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:10.996258 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.996828 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.998419 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.998674 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.998797 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.002222 (+ 3425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:11.002229 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:11.002234 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:40:11.002277 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:11.004067 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.004966 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.004970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.004972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.005078 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.005730 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.005734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.005735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.005971 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:11.006058 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.006809 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.007055 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260806 18:40:11.008078 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:10.991880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45227 (local address 127.12.177.129:40717)
0806 18:40:10.992504 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:10.992613 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:10.994211 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:10.994978 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:10.994988 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:10.995463 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:10.996059 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:10.996075 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.997040 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.997043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:10.998243 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:10.998254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:10.998870 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:10.998875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:10.999135 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:10.999882 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:10.999910 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:11.001957 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:11.004237 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.004248 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.004274 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.004771 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.005210 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.005249 (+ 39us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.005254 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.005555 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.006111 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:11.006122 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:11.006488 (+ 366us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.006682 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.007027 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":144,"threads_started":1}
I20260806 18:40:11.009825 28821 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45227
I20260806 18:40:11.010118 28821 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:40:11.010761 28821 heartbeater.cc:511] Master 127.12.177.190:45227 requested a full tablet report, sending...
I20260806 18:40:11.012687 28526 ts_manager.cc:194] Registered new tserver with Master: afa33b6ff3b943f592882506542e9658 (127.12.177.129:42645)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:40:11.014117 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:40717
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:40:11.039120 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:40:11.172147 28826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:11.172458 28826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:11.172505 28826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:11.176774 28826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:11.176860 28826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:11.176924 28826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:40:11.183476 28826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:11.184859 28826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:11.186045 28826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:40:11.196667 28836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:11.196770 28838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:11.196712 28835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:11.196905 28826 server_base.cc:1034] running on GCE node
I20260806 18:40:11.197953 28826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:11.198652 28826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:11.199855 28826 hybrid_clock.cc:648] HybridClock initialized: now 1786041611199838 us; error 32 us; skew 500 ppm
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041611, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:40:11.202777 28826 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:40:11.203707 28826 webserver.cc:460] Webserver started at http://127.12.177.130:41549/ using document root <none> and password file <none>
I20260806 18:40:11.204315 28826 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:11.204416 28826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:11.204661 28826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:11.206888 28826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "4f75b395a6564d3896278052fec31d0e"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "4f220ce4f6a41d46b0fadf46c29d0500"
server_key_iv: "2b28e39d7175e1470e577e77e49e7048"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.207520 28826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "4f75b395a6564d3896278052fec31d0e"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "4f220ce4f6a41d46b0fadf46c29d0500"
server_key_iv: "2b28e39d7175e1470e577e77e49e7048"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.211959 28826 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:40:11.214913 28846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.216411 28826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:40:11.216572 28826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "4f75b395a6564d3896278052fec31d0e"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "4f220ce4f6a41d46b0fadf46c29d0500"
server_key_iv: "2b28e39d7175e1470e577e77e49e7048"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.216734 28826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:11.232601 28826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:11.236845 28826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:11.237049 28826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:11.237790 28826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:11.238808 28826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:11.238890 28826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.238968 28826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:11.239017 28826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.249156 28826 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:43971
I20260806 18:40:11.249202 29009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:43971 every 8 connection(s)
I20260806 18:40:11.250278 28826 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:40:11.259131 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 28826
I20260806 18:40:11.259302 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:40:11.259640 12998 external_mini_cluster.cc:1428] Setting key 650826cedc8e376c9ad0f56ce8b72f2a
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041611, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:40:11.266477 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.252306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:42141 (local address 127.12.177.190:45227)
0806 18:40:11.252482 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.252486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.253658 (+ 1172us) server_negotiation.cc:407] Connection header received
0806 18:40:11.255328 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.255332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.255400 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.255482 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:11.256842 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.257493 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.258738 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.258990 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.259103 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.262008 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:11.262015 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:11.262021 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:40:11.262059 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:11.263884 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.264612 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.264615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.264616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.264699 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.265145 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.265147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.265149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.265402 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:11.265527 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.266127 (+ 600us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.266268 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 18:40:11.267521 29014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.252763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45227 (local address 127.12.177.130:42141)
0806 18:40:11.253492 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.253543 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.255044 (+ 1501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.255682 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.255691 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.256109 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:11.256659 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.256673 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.257642 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.257646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.258588 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.258599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.259174 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.259178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.259406 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.260154 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:11.260173 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:11.261800 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:11.264041 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.264051 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.264074 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.264500 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.264801 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.264807 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.264809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.265029 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.265535 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:11.265545 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:11.265837 (+ 292us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.266085 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.266458 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":124,"threads_started":1}
I20260806 18:40:11.268808 29010 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45227
I20260806 18:40:11.269109 29010 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:11.269833 29010 heartbeater.cc:511] Master 127.12.177.190:45227 requested a full tablet report, sending...
I20260806 18:40:11.271188 28526 ts_manager.cc:194] Registered new tserver with Master: 4f75b395a6564d3896278052fec31d0e (127.12.177.130:43971)
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:40:11.271881 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:42141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:40:11.293718 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:40:11.420591 29019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:40:11.420897 29019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:40:11.420984 29019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:40:11.425244 29019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:40:11.425324 29019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:40:11.425405 29019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:40:11.430816 29019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:40:11.431944 29019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:40:11.433041 29019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:40:11.443588 29019 server_base.cc:1034] running on GCE node
W20260806 18:40:11.443532 29028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:11.443557 29027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:40:11.443533 29034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:40:11.444247 29019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:40:11.444947 29019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:40:11.446169 29019 hybrid_clock.cc:648] HybridClock initialized: now 1786041611446150 us; error 54 us; skew 500 ppm
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041611, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:40:11.449250 29019 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:40:11.450485 29019 webserver.cc:460] Webserver started at http://127.12.177.131:44553/ using document root <none> and password file <none>
I20260806 18:40:11.451056 29019 fs_manager.cc:359] Metadata directory not provided
I20260806 18:40:11.451119 29019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:40:11.451303 29019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:40:11.453667 29019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "5e081cc308b7488f83d06177e120a940"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "d2b2eba9fe328dbb6ceebc9a18919726"
server_key_iv: "16f105062053d32de3a1e5e5e32265bb"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.454384 29019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "5e081cc308b7488f83d06177e120a940"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "d2b2eba9fe328dbb6ceebc9a18919726"
server_key_iv: "16f105062053d32de3a1e5e5e32265bb"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.458678 29019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 18:40:11.461743 29046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.463261 29019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:40:11.463424 29019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "5e081cc308b7488f83d06177e120a940"
format_stamp: "Formatted at 2026-08-06 18:40:11 on dist-test-slave-j2vl"
server_key: "d2b2eba9fe328dbb6ceebc9a18919726"
server_key_iv: "16f105062053d32de3a1e5e5e32265bb"
server_key_version: "encryptionkey@0"
I20260806 18:40:11.463558 29019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:40:11.483073 29019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:40:11.487061 29019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:40:11.487402 29019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:40:11.488101 29019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:40:11.489023 29019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:40:11.489073 29019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.489138 29019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:40:11.489171 29019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:40:11.500249 29019 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:43511
I20260806 18:40:11.500267 29203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:43511 every 8 connection(s)
I20260806 18:40:11.501473 29019 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:40:11.503841 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 29019
I20260806 18:40:11.503988 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:40:11.504304 12998 external_mini_cluster.cc:1428] Setting key f898c183d418a79146c496b032bbbd0c
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041611, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:40:11.517683 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.503841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:40283 (local address 127.12.177.190:45227)
0806 18:40:11.504026 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.504031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.505152 (+ 1121us) server_negotiation.cc:407] Connection header received
0806 18:40:11.507098 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.507102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.507161 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.507241 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:11.508578 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.509232 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.510579 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.510814 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.510944 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.513856 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:11.513860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:11.513862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:40:11.513891 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:11.515301 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.515898 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.515902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.515903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.515987 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.516368 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.516372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.516374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.516596 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:11.516711 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.517297 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.517496 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:40:11.518793 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.504320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45227 (local address 127.12.177.131:40283)
0806 18:40:11.504969 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.505035 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.506873 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.507439 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.507447 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.507881 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:40:11.508423 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.508438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.509421 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.509425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.510433 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.510445 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.511010 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.511015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.511215 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.511882 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:40:11.511901 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:40:11.513637 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:40:11.515450 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.515457 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.515479 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.515770 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.516088 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:40:11.516092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:40:11.516094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:40:11.516258 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:40:11.516712 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:40:11.516721 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:40:11.517029 (+ 308us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.517239 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.517647 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":166,"threads_started":1}
I20260806 18:40:11.520079 29204 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45227
I20260806 18:40:11.520399 29204 heartbeater.cc:464] Registering TS with master...
I20260806 18:40:11.521072 29204 heartbeater.cc:511] Master 127.12.177.190:45227 requested a full tablet report, sending...
I20260806 18:40:11.522439 28526 ts_manager.cc:194] Registered new tserver with Master: 5e081cc308b7488f83d06177e120a940 (127.12.177.131:43511)
I20260806 18:40:11.523048 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:40283
I20260806 18:40:11.531881 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:40:11.543078 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.534237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.12.177.190:45227)
0806 18:40:11.534444 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.534449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.534595 (+ 146us) server_negotiation.cc:407] Connection header received
0806 18:40:11.534822 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.534825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.534880 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.534966 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:40:11.535731 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.536272 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.537127 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.537459 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.537589 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.539254 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:40:11.539258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:40:11.539260 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:40:11.539291 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:40:11.541035 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.541633 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.541637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.541639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.541737 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:40:11.542050 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:40:11.542054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:40:11.542056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:40:11.542332 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:40:11.542486 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.542752 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.542893 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 18:40:11.546868 28526 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:40:11.550194 28526 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:40:11.567622 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.561335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:42645 (local address 127.0.0.1:49068)
0806 18:40:11.562187 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.562204 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.562332 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.563150 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.563158 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.563192 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:40:11.563366 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.563375 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.564589 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.564593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.565831 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.565841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.567006 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.567010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.567122 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.567160 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.567313 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.567450 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":196,"spinlock_wait_cycles":4608,"thread_start_us":100,"threads_started":1}
I20260806 18:40:11.567626 29219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.561331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43971 (local address 127.0.0.1:46398)
0806 18:40:11.562065 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.562130 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.562293 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.563151 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.563157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.563203 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:40:11.563374 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.563382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.564837 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.564840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.565933 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.565942 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.567061 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.567065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.567169 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.567198 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.567256 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.567424 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":1,"spinlock_wait_cycles":26624,"thread_start_us":121,"threads_started":1}
I20260806 18:40:11.568332 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.561455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49068 (local address 127.12.177.129:42645)
0806 18:40:11.561920 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.561928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.562464 (+ 536us) server_negotiation.cc:407] Connection header received
0806 18:40:11.562567 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.562572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.562802 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.562971 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:40:11.563505 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.564458 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.565978 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.566869 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.567008 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.567167 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.567349 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.567463 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":126,"threads_started":1}
I20260806 18:40:11.568375 29224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.562742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:43511 (local address 127.0.0.1:51008)
0806 18:40:11.563021 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.563037 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.563206 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.563928 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.563932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.563950 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:40:11.564056 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.564062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.565435 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.565439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.566525 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.566536 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.567963 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.567970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.568070 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.568092 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.568171 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.568248 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"spinlock_wait_cycles":15872,"thread_start_us":100,"threads_started":1}
I20260806 18:40:11.568512 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.562209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46398 (local address 127.12.177.130:43971)
0806 18:40:11.562617 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.562631 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.562655 (+ 24us) server_negotiation.cc:407] Connection header received
0806 18:40:11.562736 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.562741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.562952 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.563527 (+ 575us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:40:11.563706 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.564678 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.566072 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.566919 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.568047 (+ 1128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.568183 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.568234 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.568341 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":139,"threads_started":1}
I20260806 18:40:11.568531 29223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.562386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.12.177.131:43511)
0806 18:40:11.562738 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.562749 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.563119 (+ 370us) server_negotiation.cc:407] Connection header received
0806 18:40:11.563363 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.563369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.563580 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.563708 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:40:11.564201 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.565258 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.566663 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.567506 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.567627 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.567800 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.568225 (+ 425us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.568340 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":127,"threads_started":1}
I20260806 18:40:11.572026 28721 tablet_service.cc:1467] Processing CreateTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a (DEFAULT_TABLE table=test-table [id=8eaa815aafba4a70a953d21861edf353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:40:11.571849 28918 tablet_service.cc:1467] Processing CreateTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a (DEFAULT_TABLE table=test-table [id=8eaa815aafba4a70a953d21861edf353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:40:11.571849 29113 tablet_service.cc:1467] Processing CreateTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a (DEFAULT_TABLE table=test-table [id=8eaa815aafba4a70a953d21861edf353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:40:11.573081 28721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b729d3dc731a485bbe1d354ad4f2fc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:11.573089 29113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b729d3dc731a485bbe1d354ad4f2fc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:11.573082 28918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b729d3dc731a485bbe1d354ad4f2fc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:40:11.580324 29225 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: Bootstrap starting.
I20260806 18:40:11.582118 29229 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Bootstrap starting.
I20260806 18:40:11.583118 29225 tablet_bootstrap.cc:654] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:11.583981 29225 log.cc:824] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:11.584697 29229 tablet_bootstrap.cc:654] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:11.584873 29228 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Bootstrap starting.
I20260806 18:40:11.585837 29229 log.cc:824] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:11.586927 29225 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: No bootstrap required, opened a new log
I20260806 18:40:11.587164 29225 ts_tablet_manager.cc:1397] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260806 18:40:11.587940 29228 tablet_bootstrap.cc:654] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Neither blocks nor log segments found. Creating new log.
I20260806 18:40:11.587967 29229 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: No bootstrap required, opened a new log
I20260806 18:40:11.588191 29229 ts_tablet_manager.cc:1397] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:40:11.589493 29228 log.cc:824] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Log is configured to *not* fsync() on all Append() calls
I20260806 18:40:11.591640 29229 raft_consensus.cc:348] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.591938 29229 raft_consensus.cc:374] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:11.591997 29229 raft_consensus.cc:729] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f75b395a6564d3896278052fec31d0e, State: Initialized, Role: FOLLOWER
I20260806 18:40:11.592171 29228 tablet_bootstrap.cc:492] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: No bootstrap required, opened a new log
I20260806 18:40:11.592041 29225 raft_consensus.cc:348] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.592322 29225 raft_consensus.cc:374] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:11.592381 29225 raft_consensus.cc:729] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa33b6ff3b943f592882506542e9658, State: Initialized, Role: FOLLOWER
I20260806 18:40:11.592427 29228 ts_tablet_manager.cc:1397] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260806 18:40:11.592535 29229 consensus_queue.cc:260] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.592926 29225 consensus_queue.cc:260] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.593497 29010 heartbeater.cc:503] Master 127.12.177.190:45227 was elected leader, sending a full tablet report...
I20260806 18:40:11.593993 29229 ts_tablet_manager.cc:1428] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 18:40:11.594108 29225 ts_tablet_manager.cc:1428] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260806 18:40:11.594473 28821 heartbeater.cc:503] Master 127.12.177.190:45227 was elected leader, sending a full tablet report...
I20260806 18:40:11.600052 29228 raft_consensus.cc:348] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.600384 29228 raft_consensus.cc:374] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:40:11.600455 29228 raft_consensus.cc:729] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e081cc308b7488f83d06177e120a940, State: Initialized, Role: FOLLOWER
I20260806 18:40:11.600947 29228 consensus_queue.cc:260] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.601842 29204 heartbeater.cc:503] Master 127.12.177.190:45227 was elected leader, sending a full tablet report...
I20260806 18:40:11.602604 29228 ts_tablet_manager.cc:1428] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20260806 18:40:11.619402 29236 raft_consensus.cc:482] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:40:11.619768 29236 raft_consensus.cc:504] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.621788 29236 leader_election.cc:288] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afa33b6ff3b943f592882506542e9658 (127.12.177.129:42645), 4f75b395a6564d3896278052fec31d0e (127.12.177.130:43971)
I20260806 18:40:11.626019 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.622103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:43971 (local address 127.12.177.131:59877)
0806 18:40:11.622347 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.622364 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.622477 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.622783 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.622786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.622811 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:40:11.622966 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.622973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.623841 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.623846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.624731 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.624741 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.625504 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.625508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.625629 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.625677 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.625759 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.625857 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":1}
I20260806 18:40:11.626555 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.622222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59877 (local address 127.12.177.130:43971)
0806 18:40:11.622349 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.622355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.622517 (+ 162us) server_negotiation.cc:407] Connection header received
0806 18:40:11.622583 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.622586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.622643 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.622743 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:40:11.623100 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.623720 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.624881 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.625312 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.625509 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.625570 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.626337 (+ 767us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.626427 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 18:40:11.627177 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.622320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:37147 (local address 127.12.177.129:42645)
0806 18:40:11.622466 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.622471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.622914 (+ 443us) server_negotiation.cc:407] Connection header received
0806 18:40:11.622994 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.622997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.623050 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.623127 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:40:11.623384 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.624168 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.625725 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.626391 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.626508 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.626560 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.626942 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.627053 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:40:11.627290 28944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b729d3dc731a485bbe1d354ad4f2fc2a" candidate_uuid: "5e081cc308b7488f83d06177e120a940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f75b395a6564d3896278052fec31d0e" is_pre_election: true
I20260806 18:40:11.627601 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.622103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:42645 (local address 127.12.177.131:37147)
0806 18:40:11.622800 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.622813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:40:11.622907 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:40:11.623136 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:40:11.623138 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:40:11.623155 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:40:11.623260 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.623265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.624327 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.624331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.625563 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:40:11.625574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.626647 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.626650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:40:11.626781 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.626806 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 18:40:11.627355 (+ 549us) client_negotiation.cc:240] Negotiation successful
0806 18:40:11.627441 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":264,"thread_start_us":170,"threads_started":1}
I20260806 18:40:11.627700 28944 raft_consensus.cc:2454] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e081cc308b7488f83d06177e120a940 in term 0.
I20260806 18:40:11.628342 29049 leader_election.cc:302] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f75b395a6564d3896278052fec31d0e, 5e081cc308b7488f83d06177e120a940; no voters:
I20260806 18:40:11.628409 28748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b729d3dc731a485bbe1d354ad4f2fc2a" candidate_uuid: "5e081cc308b7488f83d06177e120a940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa33b6ff3b943f592882506542e9658" is_pre_election: true
I20260806 18:40:11.628731 28748 raft_consensus.cc:2454] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e081cc308b7488f83d06177e120a940 in term 0.
I20260806 18:40:11.629021 29236 raft_consensus.cc:2781] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:40:11.629122 29236 raft_consensus.cc:482] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:40:11.629165 29236 raft_consensus.cc:3037] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:11.630616 29236 raft_consensus.cc:504] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.631081 29236 leader_election.cc:288] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [CANDIDATE]: Term 1 election: Requested vote from peers afa33b6ff3b943f592882506542e9658 (127.12.177.129:42645), 4f75b395a6564d3896278052fec31d0e (127.12.177.130:43971)
I20260806 18:40:11.631830 28944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b729d3dc731a485bbe1d354ad4f2fc2a" candidate_uuid: "5e081cc308b7488f83d06177e120a940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f75b395a6564d3896278052fec31d0e"
I20260806 18:40:11.631989 28944 raft_consensus.cc:3037] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:11.631829 28748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b729d3dc731a485bbe1d354ad4f2fc2a" candidate_uuid: "5e081cc308b7488f83d06177e120a940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa33b6ff3b943f592882506542e9658"
I20260806 18:40:11.632177 28748 raft_consensus.cc:3037] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:40:11.633881 28748 raft_consensus.cc:2454] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e081cc308b7488f83d06177e120a940 in term 1.
I20260806 18:40:11.634650 28944 raft_consensus.cc:2454] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e081cc308b7488f83d06177e120a940 in term 1.
I20260806 18:40:11.635249 29049 leader_election.cc:302] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f75b395a6564d3896278052fec31d0e, 5e081cc308b7488f83d06177e120a940; no voters:
I20260806 18:40:11.635686 29236 raft_consensus.cc:2781] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:40:11.636125 29236 raft_consensus.cc:686] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 1 LEADER]: Becoming Leader. State: Replica: 5e081cc308b7488f83d06177e120a940, State: Running, Role: LEADER
I20260806 18:40:11.636765 29236 consensus_queue.cc:237] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } }
I20260806 18:40:11.641970 28524 catalog_manager.cc:5495] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e081cc308b7488f83d06177e120a940 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "5e081cc308b7488f83d06177e120a940" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e081cc308b7488f83d06177e120a940" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 43511 } health_report { overall_health: HEALTHY } } }
I20260806 18:40:11.673197 29223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.668893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.12.177.131:43511)
0806 18:40:11.669052 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:40:11.669055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:40:11.669070 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:40:11.669248 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:40:11.669250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:40:11.669310 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:40:11.669468 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:40:11.669791 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.670528 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.671479 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:40:11.671702 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:40:11.671804 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:40:11.672158 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:40:11.672616 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:40:11.672716 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 18:40:11.672943 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 18:40:11.673064 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 18:40:11.680804 28944 raft_consensus.cc:1261] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 1 FOLLOWER]: Refusing update from remote peer 5e081cc308b7488f83d06177e120a940: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:40:11.680799 28748 raft_consensus.cc:1261] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 1 FOLLOWER]: Refusing update from remote peer 5e081cc308b7488f83d06177e120a940: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:40:11.681802 29236 consensus_queue.cc:1035] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afa33b6ff3b943f592882506542e9658" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 42645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:40:11.682060 29238 consensus_queue.cc:1035] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f75b395a6564d3896278052fec31d0e" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:40:11.692605 29242 mvcc.cc:205] Tried to move back new op lower bound from 7315626441432932352 to 7315626441268449280. Current Snapshot: MvccSnapshot[applied={T|T < 7315626441432932352}]
I20260806 18:40:11.702845 28523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:40:11.703074 28523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:40:11.706054 28523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 005f0d180a594eb9b721afce019650a4: Sending DeleteTablet for 3 replicas of tablet b729d3dc731a485bbe1d354ad4f2fc2a
I20260806 18:40:11.707206 28721 tablet_service.cc:1514] Processing DeleteTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:40:11 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:49068
I20260806 18:40:11.707321 28918 tablet_service.cc:1514] Processing DeleteTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:40:11 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:46398
I20260806 18:40:11.708063 29255 tablet_replica.cc:330] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658: stopping tablet replica
I20260806 18:40:11.707955 29113 tablet_service.cc:1514] Processing DeleteTablet for tablet b729d3dc731a485bbe1d354ad4f2fc2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:40:11 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51008
I20260806 18:40:11.708277 29256 tablet_replica.cc:330] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: stopping tablet replica
I20260806 18:40:11.708622 29255 raft_consensus.cc:2229] T b729d3dc731a485bbe1d354ad4f2fc2a P afa33b6ff3b943f592882506542e9658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:40:11.708702 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 28613
I20260806 18:40:11.708739 29256 raft_consensus.cc:2229] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:40:11.709156 29256 raft_consensus.cc:2258] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:40:11.712982 29256 ts_tablet_manager.cc:1905] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:40:11.716107 29256 ts_tablet_manager.cc:1918] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:40:11.716234 29256 log.cc:1196] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/b729d3dc731a485bbe1d354ad4f2fc2a
I20260806 18:40:11.716566 29256 ts_tablet_manager.cc:1939] T b729d3dc731a485bbe1d354ad4f2fc2a P 4f75b395a6564d3896278052fec31d0e: Deleting consensus metadata
I20260806 18:40:11.718093 28506 catalog_manager.cc:4841] TS 4f75b395a6564d3896278052fec31d0e (127.12.177.130:43971): tablet b729d3dc731a485bbe1d354ad4f2fc2a (table test-table [id=8eaa815aafba4a70a953d21861edf353]) successfully deleted
I20260806 18:40:11.718863 29257 tablet_replica.cc:330] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: stopping tablet replica
I20260806 18:40:11.719442 29257 raft_consensus.cc:2229] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:40:11.719942 29257 raft_consensus.cc:2258] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:40:11.722146 29257 ts_tablet_manager.cc:1905] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:40:11.725061 29257 ts_tablet_manager.cc:1918] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:40:11.725185 29257 log.cc:1196] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/b729d3dc731a485bbe1d354ad4f2fc2a
I20260806 18:40:11.725754 29257 ts_tablet_manager.cc:1939] T b729d3dc731a485bbe1d354ad4f2fc2a P 5e081cc308b7488f83d06177e120a940: Deleting consensus metadata
I20260806 18:40:11.727249 28506 catalog_manager.cc:4841] TS 5e081cc308b7488f83d06177e120a940 (127.12.177.131:43511): tablet b729d3dc731a485bbe1d354ad4f2fc2a (table test-table [id=8eaa815aafba4a70a953d21861edf353]) successfully deleted
W20260806 18:40:11.727771 28510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:42645 (error 108)
I20260806 18:40:11.728799 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 28826
I20260806 18:40:11.729020 29224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:40:11.728655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:42645 (local address 127.0.0.1:49070)
0806 18:40:11.728819 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 18:40:11.728907 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:42645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 18:40:11.754750 28510 catalog_manager.cc:4584] TS afa33b6ff3b943f592882506542e9658 (127.12.177.129:42645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b729d3dc731a485bbe1d354ad4f2fc2a: Network error: Client connection negotiation failed: client connection to 127.12.177.129:42645: connect: Connection refused (error 111)
I20260806 18:40:11.764757 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 29019
I20260806 18:40:11.787559 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 28477
2026-08-06T18:40:11Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2825 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[29269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[29269](info): set up 2 sockets
Aug 06 18:40:11 dist-test-slave-j2vl krb5kdc[29269](info): commencing operation
krb5kdc: starting...
W20260806 18:40:13.075938 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:40:13 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:40:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:40:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangeradmin_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangeradmin_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangerlookup_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangerlookup_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
I20260806 18:40:13.289093 12998 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9NHeiD/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/postgres -l logfile start
2026-08-06 18:40:16.380 UTC [29309] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 18:40:16.380 UTC [29309] LOG: listening on IPv4 address "127.12.177.148", port 47797
2026-08-06 18:40:16.385 UTC [29309] LOG: listening on Unix socket "/tmp/.s.PGSQL.47797"
2026-08-06 18:40:16.411 UTC [29314] LOG: database system was shut down at 2026-08-06 18:40:14 UTC
2026-08-06 18:40:16.416 UTC [29309] LOG: database system is ready to accept connections
I20260806 18:40:17.576077 12998 mini_postgres.cc:96] Postgres bound to 47797
2026-08-06 18:40:17.585 UTC [29332] FATAL: database "slave" does not exist
127.12.177.148:47797 - accepting connections
I20260806 18:40:17.588016 12998 mini_ranger.cc:161] Starting Ranger...
I20260806 18:40:17.608081 12998 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 18:40:18.248404 12998 mini_ranger.cc:87] Created ranger Postgres database
I20260806 18:40:18.248522 12998 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin
2026-08-06 18:40:18,589 [I] DB FLAVOR :POSTGRES
2026-08-06 18:40:18,590 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 18:40:18,590 [I] Checking connection..
2026-08-06 18:40:18,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 18:40:18,861 [I] Checking connection passed.
2026-08-06 18:40:18,861 [I] --------- Verifying version history table ---------
2026-08-06 18:40:18,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:40:19,159 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 18:40:19,160 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:40:19,420 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 18:40:19,421 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 18:40:19,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 18:40:19.693 UTC [29431] WARNING: there is no transaction in progress
2026-08-06 18:40:19,702 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 18:40:19,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:40:19,956 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 18:40:19,956 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 18:40:19,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 18:40:20,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 18:40:20,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-j2vl.c.gcp-upstream.internal','N') ;"
2026-08-06 18:40:20,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 18:40:21,023 [I] Table x_portal_user does not exist in database ranger
2026-08-06 18:40:21,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 18:40:21,311 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 18:40:21,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 18:40:21,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 18:40:21,846 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 18:40:21,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 18:40:23.012 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.031 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.050 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.070 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.090 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.116 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.195 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.204 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.223 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.236 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.249 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.266 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.278 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.286 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.295 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:23.304 UTC [29594] WARNING: there is no transaction in progress
2026-08-06 18:40:24,229 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 18:40:24,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 18:40:24,492 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 18:40:24,492 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 18:40:24,777 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 18:40:24,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 18:40:25,066 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 18:40:25,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 18:40:25,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 18:40:25,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-j2vl.c.gcp-upstream.internal';"
2026-08-06 18:40:25,868 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 18:40:25,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 18:40:26,157 [I] DB_PATCHES have already been applied
I20260806 18:40:26.163254 12998 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9NHeiD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 18:40:26.163376 12998 mini_ranger.cc:193] Using host: 127.12.177.148
I20260806 18:40:26.168457 12998 mini_ranger.cc:227] Ranger admin URL: http://127.12.177.148:55795
Aug 06, 2026 6:40:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 6:40:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 6:40:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 6:40:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 6:40:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 6:40:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 6:40:27 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 18:40:27.556097 12998 mini_ranger.cc:160] Time spent starting Ranger: real 9.968s user 0.000s sys 0.016s
Aug 06, 2026 6:40:52 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 6:40:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 6:40:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 6:40:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 6:40:53 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 18:40:54.427794 12998 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangerkms_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/rangerkms_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.177.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.177.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 18:40:54 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041654, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 18:40:54.546731 12998 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 18:40:54.565582 12998 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 18:40:55.510607 12998 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 18:40:55.510702 12998 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms
I20260806 18:40:55.510766 12998 mini_ranger_kms.cc:227] Using postgres at 127.12.177.148:47797
2026-08-06 18:40:56,386 [I] DB FLAVOR :POSTGRES
2026-08-06 18:40:56,387 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 18:40:56,387 [I] Checking connection
2026-08-06 18:40:56,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 18:40:56,753 [I] connection success
2026-08-06 18:40:56,753 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 18:40:56,753 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 18:40:56,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 18:40:57,036 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 18:40:57,037 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 18:40:57,037 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 18:40:57,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:47797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 18:40:57,356 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 18:40:57.881408 12998 mini_ranger_kms.cc:310] Created kms service
I20260806 18:40:58.099135 12998 mini_ranger_kms.cc:326] Created kudu user
I20260806 18:40:58.153429 12998 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 18:40:58 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041654, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:40:58.648708 12998 mini_ranger_kms.cc:384] Added ranger policy
I20260806 18:40:58.648900 12998 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms:/tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 18:40:58.648926 12998 mini_ranger_kms.cc:240] Using host: 127.12.177.148
I20260806 18:40:58.655715 12998 mini_ranger_kms.cc:276] Ranger KMS PID: 29882
I20260806 18:40:58.655889 12998 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.177.148:35109
Aug 06, 2026 6:40:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 6:40:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 6:41:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 6:41:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 6:41:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 6:41:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 18:41:01.499462 12998 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.953s user 0.005s sys 0.713s
I20260806 18:41:01.499629 12998 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 18:41:01.499851 12998 mini_ranger_kms.cc:401] 127.12.177.148:35109/kms/v1/keys
Aug 06 18:41:01 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786041661, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 18:41:02 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041661, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
Aug 06 18:41:02 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041661, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
Aug 06 18:41:05 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:41:05.705996 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36029
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:36029
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:35109/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:41:05.852689 29955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:41:05.853039 29955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:41:05.853086 29955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:41:05.857650 29955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:41:05.857745 29955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:41:05.857765 29955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:41:05.857784 29955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:41:05.857800 29955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:41:05.864684 29955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.177.148:35109/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:36029
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:41:05.866117 29955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:41:05.867620 29955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:41:05.879513 29967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:05.879520 29968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:05.879696 29974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:41:05.879757 29955 server_base.cc:1034] running on GCE node
I20260806 18:41:05.881184 29955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:41:05.883023 29955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:41:05.884265 29955 hybrid_clock.cc:648] HybridClock initialized: now 1786041665884223 us; error 58 us; skew 500 ppm
Aug 06 18:41:05 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041665, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:41:05.888597 29955 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:41:05.890254 29955 webserver.cc:460] Webserver started at http://127.12.177.190:41481/ using document root <none> and password file <none>
I20260806 18:41:05.890914 29955 fs_manager.cc:359] Metadata directory not provided
I20260806 18:41:05.891021 29955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:41:05.891284 29955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:41:05 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041665, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:05.967955 29955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "9005eab916814a51a0a240c37ff4c6e0"
format_stamp: "Formatted at 2026-08-06 18:41:05 on dist-test-slave-j2vl"
server_key: "4fd8e7a147ba6cecb89e74848888e9bd"
server_key_iv: "e0857da29fd4a465093bed568aea870e"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:05.968701 29955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "9005eab916814a51a0a240c37ff4c6e0"
format_stamp: "Formatted at 2026-08-06 18:41:05 on dist-test-slave-j2vl"
server_key: "4fd8e7a147ba6cecb89e74848888e9bd"
server_key_iv: "e0857da29fd4a465093bed568aea870e"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:05.973609 29955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:41:05.997794 29986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:05.999351 29955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:41:05.999524 29955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "9005eab916814a51a0a240c37ff4c6e0"
format_stamp: "Formatted at 2026-08-06 18:41:05 on dist-test-slave-j2vl"
server_key: "4fd8e7a147ba6cecb89e74848888e9bd"
server_key_iv: "e0857da29fd4a465093bed568aea870e"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:05.999681 29955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:41:06.014815 29955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:41:06.018381 29955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:41:06.018656 29955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:41:06.030712 29955 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:36029
I20260806 18:41:06.030923 30054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:36029 every 8 connection(s)
I20260806 18:41:06.032246 29955 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:41:06.036005 30057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:41:06.037704 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 29955
I20260806 18:41:06.037856 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:41:06.038183 12998 external_mini_cluster.cc:1428] Setting key 65f2cd8b6d9046c692b45eaea2a2c397
I20260806 18:41:06.046103 30057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: Bootstrap starting.
I20260806 18:41:06.050225 30057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: Neither blocks nor log segments found. Creating new log.
I20260806 18:41:06.051813 30057 log.cc:824] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:41:06 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:41:06.055009 30057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: No bootstrap required, opened a new log
I20260806 18:41:06.060554 30061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:06.040310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45564 (local address 127.12.177.190:36029)
0806 18:41:06.041093 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:06.041116 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:06.041169 (+ 53us) server_negotiation.cc:407] Connection header received
0806 18:41:06.042391 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:06.042421 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:06.042956 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:06.043680 (+ 724us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:41:06.044573 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:06.046396 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:06.047935 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:06.048766 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:06.048965 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:06.053059 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:41:06.053066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:41:06.053087 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:41:06.053120 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:41:06.056408 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:06.057115 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:06.057121 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:06.057129 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:06.057298 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:06.057722 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:06.057726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:06.057727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:06.058356 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:41:06.058564 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:06.059028 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 18:41:06.059411 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":263,"threads_started":1}
I20260806 18:41:06.060453 30057 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } }
I20260806 18:41:06.060772 30057 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:41:06.060877 30057 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9005eab916814a51a0a240c37ff4c6e0, State: Initialized, Role: FOLLOWER
I20260806 18:41:06.061439 30057 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } }
I20260806 18:41:06.061758 30057 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:41:06.061908 30057 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:41:06.062058 30057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:41:06.063553 30057 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } }
I20260806 18:41:06.063957 30057 leader_election.cc:302] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9005eab916814a51a0a240c37ff4c6e0; no voters:
I20260806 18:41:06.064396 30057 leader_election.cc:288] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:41:06.064566 30063 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:41:06.064831 30063 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [term 1 LEADER]: Becoming Leader. State: Replica: 9005eab916814a51a0a240c37ff4c6e0, State: Running, Role: LEADER
I20260806 18:41:06.065412 30063 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } }
I20260806 18:41:06.066172 30057 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:41:06.066953 30063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9005eab916814a51a0a240c37ff4c6e0. Latest consensus state: current_term: 1 leader_uuid: "9005eab916814a51a0a240c37ff4c6e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } } }
I20260806 18:41:06.067216 30063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:41:06.067569 30068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9005eab916814a51a0a240c37ff4c6e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9005eab916814a51a0a240c37ff4c6e0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36029 } } }
I20260806 18:41:06.067724 30068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:41:06.069721 30057 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 18:41:06.069798 30077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:41:06.074069 30077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:41:06.092432 30077 catalog_manager.cc:1347] Generated new cluster ID: 136620818b724eb28aed9e2b9a655931
I20260806 18:41:06.092542 30077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:41:06.106842 30077 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:41:06.108295 30077 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:41:06.118547 30077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: Generated new TSK 0
I20260806 18:41:06.119731 30077 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:41:07.092470 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:35109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:41:07.275878 30124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:41:07.276250 30124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:41:07.276373 30124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:41:07.281318 30124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:41:07.281489 30124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:41:07.281595 30124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:41:07.289780 30124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.177.148:35109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:41:07.291389 30124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:41:07.292917 30124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:41:07.307394 30132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:07.308904 30129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:07.309809 30130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:41:07.313311 30124 server_base.cc:1034] running on GCE node
I20260806 18:41:07.314190 30124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:41:07.315331 30124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:41:07.316583 30124 hybrid_clock.cc:648] HybridClock initialized: now 1786041667316532 us; error 72 us; skew 500 ppm
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:41:07.320773 30124 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:41:07.322115 30124 webserver.cc:460] Webserver started at http://127.12.177.129:35115/ using document root <none> and password file <none>
I20260806 18:41:07.322786 30124 fs_manager.cc:359] Metadata directory not provided
I20260806 18:41:07.322901 30124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:41:07.323153 30124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:07.342620 30124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "59bdeae6deca49df825c0296599a0c2b"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "522159babba7c195e8454116c39862b8"
server_key_iv: "81039d4df640335f19265fbc401f9854"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.343427 30124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "59bdeae6deca49df825c0296599a0c2b"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "522159babba7c195e8454116c39862b8"
server_key_iv: "81039d4df640335f19265fbc401f9854"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.349121 30124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 18:41:07.368209 30144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.369957 30124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:41:07.370139 30124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "59bdeae6deca49df825c0296599a0c2b"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "522159babba7c195e8454116c39862b8"
server_key_iv: "81039d4df640335f19265fbc401f9854"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.370291 30124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:41:07.386977 30124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:41:07.390574 30124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:41:07.390818 30124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:41:07.391605 30124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:41:07.392668 30124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:41:07.392741 30124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.392840 30124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:41:07.392879 30124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.413439 30124 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:44785
I20260806 18:41:07.414669 30124 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:41:07.415809 30344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:44785 every 8 connection(s)
I20260806 18:41:07.417121 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 30124
I20260806 18:41:07.417255 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:41:07.419636 12998 external_mini_cluster.cc:1428] Setting key 780b7390918debbfc26f6b3ce9b24892
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:41:07.455657 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:07.428295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:48345 (local address 127.12.177.190:36029)
0806 18:41:07.432682 (+ 4387us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:07.432688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:07.432713 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:41:07.432772 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:07.432776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:07.432842 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:07.435507 (+ 2665us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:41:07.435701 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.436665 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.439217 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.439645 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.439814 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:07.449897 (+ 10083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:41:07.449902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:41:07.449905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:41:07.449948 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:41:07.452280 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:07.453252 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:07.453259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:07.453264 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:07.453417 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:07.453933 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:07.453939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:07.453944 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:07.454244 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:41:07.454339 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:07.455188 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 18:41:07.455385 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4262,"thread_start_us":96,"threads_started":1}
I20260806 18:41:07.457952 30348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:07.426697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36029 (local address 127.12.177.129:48345)
0806 18:41:07.428539 (+ 1842us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:07.428619 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:07.430099 (+ 1480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:07.433543 (+ 3444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:07.433665 (+ 122us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:07.434257 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:41:07.435250 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:07.435284 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.436878 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.436883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:07.438955 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:07.438977 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.440106 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.440113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:07.440414 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:07.441578 (+ 1164us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:41:07.441605 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:41:07.449540 (+ 7935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:41:07.452514 (+ 2974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:07.452524 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:07.452549 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:07.453100 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:07.453566 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:07.453569 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:07.453572 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:07.453805 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:07.454435 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:41:07.454446 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:41:07.454867 (+ 421us) client_negotiation.cc:769] Sending connection context
0806 18:41:07.456209 (+ 1342us) client_negotiation.cc:240] Negotiation successful
0806 18:41:07.456649 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1539,"thread_start_us":265,"threads_started":1}
I20260806 18:41:07.460160 30345 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36029
I20260806 18:41:07.460492 30345 heartbeater.cc:464] Registering TS with master...
I20260806 18:41:07.461612 30345 heartbeater.cc:511] Master 127.12.177.190:36029 requested a full tablet report, sending...
I20260806 18:41:07.463987 29998 ts_manager.cc:194] Registered new tserver with Master: 59bdeae6deca49df825c0296599a0c2b (127.12.177.129:44785)
I20260806 18:41:07.466154 29998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:48345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:41:07.490649 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:35109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 18:41:07.708784 30353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:41:07.709133 30353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:41:07.709223 30353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:41:07.714660 30353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:41:07.714774 30353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:41:07.714870 30353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:41:07.723713 30353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.177.148:35109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:41:07.725337 30353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:41:07.727037 30353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:41:07.742942 30364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:07.742942 30363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:07.743387 30366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:41:07.744545 30353 server_base.cc:1034] running on GCE node
I20260806 18:41:07.745112 30353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:41:07.746111 30353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:41:07.747437 30353 hybrid_clock.cc:648] HybridClock initialized: now 1786041667747396 us; error 54 us; skew 500 ppm
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:41:07.750955 30353 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:41:07.752120 30353 webserver.cc:460] Webserver started at http://127.12.177.130:40973/ using document root <none> and password file <none>
I20260806 18:41:07.752763 30353 fs_manager.cc:359] Metadata directory not provided
I20260806 18:41:07.752830 30353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:41:07.753023 30353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:07.769290 30353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "05bb4a45f4bd4992a345b99b82c2ff59"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "5fd2f6f335c951eb7348bc4e422edb67"
server_key_iv: "683e68cc59ec4ec73702d404972a9124"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.770280 30353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "05bb4a45f4bd4992a345b99b82c2ff59"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "5fd2f6f335c951eb7348bc4e422edb67"
server_key_iv: "683e68cc59ec4ec73702d404972a9124"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.777124 30353 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 18:41:07.801447 30377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.803936 30353 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:41:07.804116 30353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "05bb4a45f4bd4992a345b99b82c2ff59"
format_stamp: "Formatted at 2026-08-06 18:41:07 on dist-test-slave-j2vl"
server_key: "5fd2f6f335c951eb7348bc4e422edb67"
server_key_iv: "683e68cc59ec4ec73702d404972a9124"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:07.804286 30353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:41:07.836095 30353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:41:07.840665 30353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:41:07.840939 30353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:41:07.841802 30353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:41:07.843070 30353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:41:07.843145 30353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.843204 30353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:41:07.843235 30353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:07.865233 30353 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:32813
I20260806 18:41:07.867519 30550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:32813 every 8 connection(s)
I20260806 18:41:07.869153 30353 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:41:07.871125 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 30353
I20260806 18:41:07.871279 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:41:07.871592 12998 external_mini_cluster.cc:1428] Setting key 75f8dcd91fe37bc1596296646804f14d
Aug 06 18:41:07 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:41:07.898746 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:07.881655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:41625 (local address 127.12.177.190:36029)
0806 18:41:07.881839 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:07.881844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:07.882556 (+ 712us) server_negotiation.cc:407] Connection header received
0806 18:41:07.884332 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:07.884337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:07.884409 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:07.884465 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:41:07.886630 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.887421 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.889448 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.889832 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.889919 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:07.893846 (+ 3927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:41:07.893851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:41:07.893854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:41:07.893892 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:41:07.895825 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:07.896639 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:07.896644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:07.896646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:07.896752 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:07.897218 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:07.897222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:07.897224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:07.897507 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:41:07.897600 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:07.898391 (+ 791us) server_negotiation.cc:299] Negotiation successful
0806 18:41:07.898561 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 18:41:07.901021 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:07.880555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36029 (local address 127.12.177.130:41625)
0806 18:41:07.882348 (+ 1793us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:07.882423 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:07.883995 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:07.884962 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:07.884972 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:07.885553 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:41:07.886402 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:07.886426 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.887643 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.887647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:07.889255 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:07.889268 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:07.890172 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:07.890176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:07.890427 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:07.891360 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:41:07.891384 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:41:07.893559 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:41:07.896034 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:07.896042 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:07.896065 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:07.896498 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:07.896873 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:07.896876 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:07.896878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:07.897102 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:07.897684 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:41:07.897692 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:41:07.898087 (+ 395us) client_negotiation.cc:769] Sending connection context
0806 18:41:07.899315 (+ 1228us) client_negotiation.cc:240] Negotiation successful
0806 18:41:07.899753 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1530,"thread_start_us":245,"threads_started":1}
I20260806 18:41:07.902967 30551 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36029
I20260806 18:41:07.903314 30551 heartbeater.cc:464] Registering TS with master...
I20260806 18:41:07.904142 30551 heartbeater.cc:511] Master 127.12.177.190:36029 requested a full tablet report, sending...
I20260806 18:41:07.905591 29998 ts_manager.cc:194] Registered new tserver with Master: 05bb4a45f4bd4992a345b99b82c2ff59 (127.12.177.130:32813)
I20260806 18:41:07.906554 29998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:41625
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:41:07.938522 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:35109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:41:08.142074 30556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:41:08.142539 30556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:41:08.142692 30556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:41:08.149713 30556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:41:08.149818 30556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:41:08.149919 30556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:41:08.159060 30556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.177.148:35109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:41:08.160854 30556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:41:08.162524 30556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:41:08.177392 30562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:08.178010 30566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:41:08.178200 30563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:41:08.179651 30556 server_base.cc:1034] running on GCE node
I20260806 18:41:08.180312 30556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:41:08.181282 30556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:41:08.182521 30556 hybrid_clock.cc:648] HybridClock initialized: now 1786041668182494 us; error 45 us; skew 500 ppm
Aug 06 18:41:08 dist-test-slave-j2vl krb5kdc[29269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041668, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:41:08.188369 30556 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:41:08.189855 30556 webserver.cc:460] Webserver started at http://127.12.177.131:32771/ using document root <none> and password file <none>
I20260806 18:41:08.190704 30556 fs_manager.cc:359] Metadata directory not provided
I20260806 18:41:08.190896 30556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:41:08.191285 30556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:41:08 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041668, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:08.209465 30556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "58963ebe16834e1189d61e0cf39d4e98"
format_stamp: "Formatted at 2026-08-06 18:41:08 on dist-test-slave-j2vl"
server_key: "8d93e92a8f4210e8660fa40f3312522c"
server_key_iv: "566b7a910e4744b0342bc167b7ec910c"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:08.211058 30556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "58963ebe16834e1189d61e0cf39d4e98"
format_stamp: "Formatted at 2026-08-06 18:41:08 on dist-test-slave-j2vl"
server_key: "8d93e92a8f4210e8660fa40f3312522c"
server_key_iv: "566b7a910e4744b0342bc167b7ec910c"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:08.217898 30556 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 18:41:08.246765 30577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:08.248862 30556 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:41:08.249053 30556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "58963ebe16834e1189d61e0cf39d4e98"
format_stamp: "Formatted at 2026-08-06 18:41:08 on dist-test-slave-j2vl"
server_key: "8d93e92a8f4210e8660fa40f3312522c"
server_key_iv: "566b7a910e4744b0342bc167b7ec910c"
server_key_version: "kuduclusterkey@0"
I20260806 18:41:08.249233 30556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 06 18:41:08 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041667, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:08.305773 30556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:41:08.309638 30556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:41:08.309876 30556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:41:08.310706 30556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:41:08.311770 30556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:41:08.311851 30556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:08.311923 30556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:41:08.311956 30556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:41:08.330456 30556 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:46283
I20260806 18:41:08.331892 30556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:41:08.336910 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 30556
I20260806 18:41:08.337069 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:41:08.337407 12998 external_mini_cluster.cc:1428] Setting key a7b9c300a5683ac24c258e2519387806
I20260806 18:41:08.338224 30750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:46283 every 8 connection(s)
Aug 06 18:41:08 dist-test-slave-j2vl krb5kdc[29269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041668, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:41:08.356132 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.336443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:54339 (local address 127.12.177.190:36029)
0806 18:41:08.336592 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.336597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.342012 (+ 5415us) server_negotiation.cc:407] Connection header received
0806 18:41:08.343600 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.343604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.343674 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.343740 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:41:08.345606 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.346165 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.347417 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.347712 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.347824 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.351110 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:41:08.351113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:41:08.351116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:41:08.351152 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:41:08.353295 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:08.354070 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:08.354074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:08.354076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:08.354165 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:08.354575 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:08.354578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:08.354580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:08.354834 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:41:08.354915 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.355772 (+ 857us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.355948 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:41:08.358510 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.336927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36029 (local address 127.12.177.131:54339)
0806 18:41:08.341785 (+ 4858us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.341898 (+ 113us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.343308 (+ 1410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.344274 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.344285 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.344744 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:41:08.345440 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.345460 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.346303 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.346307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.347269 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.347279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.347898 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.347904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.348096 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.348782 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:41:08.348799 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:41:08.350749 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:41:08.353506 (+ 2757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:08.353514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:08.353538 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:08.353949 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:08.354266 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:41:08.354269 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:41:08.354271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:41:08.354470 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:41:08.354999 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:41:08.355006 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:41:08.355385 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.356872 (+ 1487us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.357297 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4546,"thread_start_us":229,"threads_started":1}
I20260806 18:41:08.360283 30751 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36029
I20260806 18:41:08.360586 30751 heartbeater.cc:464] Registering TS with master...
I20260806 18:41:08.361430 30751 heartbeater.cc:511] Master 127.12.177.190:36029 requested a full tablet report, sending...
I20260806 18:41:08.364823 29998 ts_manager.cc:194] Registered new tserver with Master: 58963ebe16834e1189d61e0cf39d4e98 (127.12.177.131:46283)
I20260806 18:41:08.367017 29998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:54339
I20260806 18:41:08.376353 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:41:08.389283 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.379012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45566 (local address 127.12.177.190:36029)
0806 18:41:08.379144 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.379148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.379438 (+ 290us) server_negotiation.cc:407] Connection header received
0806 18:41:08.379568 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.379571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.379625 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.379714 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:41:08.380750 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.381635 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.382910 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.383234 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.383345 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.385249 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:41:08.385253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:41:08.385256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:41:08.385291 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:41:08.387203 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:08.387781 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:08.387785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:08.387787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:08.387888 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:41:08.388216 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:41:08.388219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:41:08.388221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:41:08.388468 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:41:08.388605 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.388922 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.389062 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:41:08.393143 29998 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45566:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:41:08.398568 29998 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:41:08.425441 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.412189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41680 (local address 127.12.177.129:44785)
0806 18:41:08.417585 (+ 5396us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.417593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.418229 (+ 636us) server_negotiation.cc:407] Connection header received
0806 18:41:08.418318 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.418323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.418571 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.418725 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:41:08.420115 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.421035 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.422918 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.424152 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.424279 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.424454 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.425081 (+ 627us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.425214 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5271,"thread_start_us":135,"threads_started":1}
I20260806 18:41:08.425556 30775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.411141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44785 (local address 127.0.0.1:41680)
0806 18:41:08.417796 (+ 6655us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.417884 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.418047 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.419100 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.419107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.419126 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:41:08.419651 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.419661 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.421176 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.421179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.422758 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.422768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.424531 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.424535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.424677 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.424737 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.424860 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.425291 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6560,"mutex_wait_us":227,"thread_start_us":160,"threads_started":1}
I20260806 18:41:08.428576 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.413444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53920 (local address 127.12.177.130:32813)
0806 18:41:08.421858 (+ 8414us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.421867 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.421892 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:41:08.421974 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.421979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.422162 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.422311 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:41:08.422830 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.423979 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.426997 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.427806 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.428003 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.428212 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.428304 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.428420 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8279,"thread_start_us":128,"threads_started":1}
I20260806 18:41:08.428493 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.413148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:32813 (local address 127.0.0.1:53920)
0806 18:41:08.421406 (+ 8258us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.421423 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.421548 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.422488 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.422492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.422512 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:41:08.422673 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.422679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.424809 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.424814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.426829 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.426842 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.427992 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.427997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.428092 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.428121 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.428198 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.428298 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8139,"mutex_wait_us":317,"thread_start_us":146,"threads_started":1}
I20260806 18:41:08.429598 30219 tablet_service.cc:1467] Processing CreateTablet for tablet db7c09d7b9b847c5896537c801df2adf (DEFAULT_TABLE table=test-table [id=33e8f391ce4e4f6e97b255891b8b0fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:41:08.430974 30219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7c09d7b9b847c5896537c801df2adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:41:08.432426 30446 tablet_service.cc:1467] Processing CreateTablet for tablet db7c09d7b9b847c5896537c801df2adf (DEFAULT_TABLE table=test-table [id=33e8f391ce4e4f6e97b255891b8b0fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:41:08.433732 30446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7c09d7b9b847c5896537c801df2adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:41:08.440398 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.411038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:46283 (local address 127.0.0.1:52786)
0806 18:41:08.418865 (+ 7827us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.418882 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.418983 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.422379 (+ 3396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.422383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.422405 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:41:08.422563 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.422571 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.424747 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.424750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.426549 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.426564 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.439814 (+ 13250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.439818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.439945 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.439974 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.440066 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.440178 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6106,"mutex_wait_us":78,"thread_start_us":112,"threads_started":1}
I20260806 18:41:08.441255 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.411985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.12.177.131:46283)
0806 18:41:08.417619 (+ 5634us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.417633 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.421521 (+ 3888us) server_negotiation.cc:407] Connection header received
0806 18:41:08.421648 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.421655 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.421955 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.422186 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:41:08.422728 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.424588 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.438202 (+ 13614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.439333 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.439528 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.439697 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.440949 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.441100 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5492,"thread_start_us":137,"threads_started":1}
I20260806 18:41:08.442032 30783 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: Bootstrap starting.
I20260806 18:41:08.444875 30783 tablet_bootstrap.cc:654] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: Neither blocks nor log segments found. Creating new log.
I20260806 18:41:08.445907 30783 log.cc:824] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:41:08.444866 30649 tablet_service.cc:1467] Processing CreateTablet for tablet db7c09d7b9b847c5896537c801df2adf (DEFAULT_TABLE table=test-table [id=33e8f391ce4e4f6e97b255891b8b0fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:41:08.447510 30649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7c09d7b9b847c5896537c801df2adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:41:08.449519 30783 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: No bootstrap required, opened a new log
I20260806 18:41:08.449767 30783 ts_tablet_manager.cc:1397] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 18:41:08.454777 30783 raft_consensus.cc:348] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.455221 30783 raft_consensus.cc:374] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:41:08.455293 30783 raft_consensus.cc:729] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59bdeae6deca49df825c0296599a0c2b, State: Initialized, Role: FOLLOWER
I20260806 18:41:08.455909 30783 consensus_queue.cc:260] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.457683 30783 ts_tablet_manager.cc:1428] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260806 18:41:08.458667 30345 heartbeater.cc:503] Master 127.12.177.190:36029 was elected leader, sending a full tablet report...
I20260806 18:41:08.462383 30785 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Bootstrap starting.
I20260806 18:41:08.468179 30785 tablet_bootstrap.cc:654] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Neither blocks nor log segments found. Creating new log.
I20260806 18:41:08.469753 30785 log.cc:824] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Log is configured to *not* fsync() on all Append() calls
I20260806 18:41:08.469935 30787 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Bootstrap starting.
I20260806 18:41:08.472995 30785 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: No bootstrap required, opened a new log
I20260806 18:41:08.473284 30785 ts_tablet_manager.cc:1397] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20260806 18:41:08.473668 30787 tablet_bootstrap.cc:654] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Neither blocks nor log segments found. Creating new log.
I20260806 18:41:08.473738 30786 raft_consensus.cc:482] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:41:08.473996 30786 raft_consensus.cc:504] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.474989 30787 log.cc:824] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Log is configured to *not* fsync() on all Append() calls
I20260806 18:41:08.475561 30786 leader_election.cc:288] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58963ebe16834e1189d61e0cf39d4e98 (127.12.177.131:46283), 05bb4a45f4bd4992a345b99b82c2ff59 (127.12.177.130:32813)
I20260806 18:41:08.477813 30787 tablet_bootstrap.cc:492] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: No bootstrap required, opened a new log
I20260806 18:41:08.478113 30787 ts_tablet_manager.cc:1397] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260806 18:41:08.483654 30787 raft_consensus.cc:348] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.484083 30787 raft_consensus.cc:374] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:41:08.484159 30787 raft_consensus.cc:729] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58963ebe16834e1189d61e0cf39d4e98, State: Initialized, Role: FOLLOWER
I20260806 18:41:08.484140 30785 raft_consensus.cc:348] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.484587 30785 raft_consensus.cc:374] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:41:08.484675 30785 raft_consensus.cc:729] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05bb4a45f4bd4992a345b99b82c2ff59, State: Initialized, Role: FOLLOWER
I20260806 18:41:08.485114 30787 consensus_queue.cc:260] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.485246 30785 consensus_queue.cc:260] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.486418 30787 ts_tablet_manager.cc:1428] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 18:41:08.486711 30785 ts_tablet_manager.cc:1428] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Time spent starting tablet: real 0.013s user 0.009s sys 0.000s
I20260806 18:41:08.486886 30751 heartbeater.cc:503] Master 127.12.177.190:36029 was elected leader, sending a full tablet report...
I20260806 18:41:08.487111 30551 heartbeater.cc:503] Master 127.12.177.190:36029 was elected leader, sending a full tablet report...
I20260806 18:41:08.496599 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.484541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:54391 (local address 127.12.177.131:46283)
0806 18:41:08.484730 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.484734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.484754 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:41:08.485669 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.485676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.485744 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.485809 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:41:08.487235 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.488083 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.491999 (+ 3916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.492668 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.492780 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.492839 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.496299 (+ 3460us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.496457 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:41:08.497197 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.476069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:46283 (local address 127.12.177.129:54391)
0806 18:41:08.484408 (+ 8339us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.484432 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.485176 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.485988 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.485991 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.486011 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:41:08.486459 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.486473 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.489335 (+ 2862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.489363 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.491274 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.491324 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.493057 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.493061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.493228 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.493257 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.496850 (+ 3593us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.496967 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8003,"thread_start_us":155,"threads_started":1}
I20260806 18:41:08.498108 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.477074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:38795 (local address 127.12.177.130:32813)
0806 18:41:08.477239 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.477261 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.485104 (+ 7843us) server_negotiation.cc:407] Connection header received
0806 18:41:08.486675 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.486679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.486748 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.486813 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:41:08.493538 (+ 6725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.494286 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.496441 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.497190 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.497306 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.497391 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.497864 (+ 473us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.497966 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:41:08.498172 30682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7c09d7b9b847c5896537c801df2adf" candidate_uuid: "59bdeae6deca49df825c0296599a0c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58963ebe16834e1189d61e0cf39d4e98" is_pre_election: true
I20260806 18:41:08.498616 30682 raft_consensus.cc:2454] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59bdeae6deca49df825c0296599a0c2b in term 0.
I20260806 18:41:08.498704 30792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.476579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:32813 (local address 127.12.177.129:38795)
0806 18:41:08.484888 (+ 8309us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.484906 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:41:08.485448 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:41:08.487042 (+ 1594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:41:08.487045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:41:08.487068 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:41:08.491803 (+ 4735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.491815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.494536 (+ 2721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.494539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.496264 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:41:08.496279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.497521 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.497525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:41:08.497683 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.497710 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:41:08.498337 (+ 627us) client_negotiation.cc:240] Negotiation successful
0806 18:41:08.498450 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8226,"thread_start_us":119,"threads_started":1}
I20260806 18:41:08.499311 30148 leader_election.cc:302] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58963ebe16834e1189d61e0cf39d4e98, 59bdeae6deca49df825c0296599a0c2b; no voters:
I20260806 18:41:08.499717 30786 raft_consensus.cc:2781] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:41:08.499805 30786 raft_consensus.cc:482] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:41:08.499845 30786 raft_consensus.cc:3037] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:41:08.499747 30473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7c09d7b9b847c5896537c801df2adf" candidate_uuid: "59bdeae6deca49df825c0296599a0c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" is_pre_election: true
I20260806 18:41:08.500123 30473 raft_consensus.cc:2454] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59bdeae6deca49df825c0296599a0c2b in term 0.
I20260806 18:41:08.501729 30786 raft_consensus.cc:504] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.502164 30786 leader_election.cc:288] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [CANDIDATE]: Term 1 election: Requested vote from peers 58963ebe16834e1189d61e0cf39d4e98 (127.12.177.131:46283), 05bb4a45f4bd4992a345b99b82c2ff59 (127.12.177.130:32813)
I20260806 18:41:08.502665 30682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7c09d7b9b847c5896537c801df2adf" candidate_uuid: "59bdeae6deca49df825c0296599a0c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58963ebe16834e1189d61e0cf39d4e98"
I20260806 18:41:08.502728 30473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7c09d7b9b847c5896537c801df2adf" candidate_uuid: "59bdeae6deca49df825c0296599a0c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05bb4a45f4bd4992a345b99b82c2ff59"
I20260806 18:41:08.502825 30682 raft_consensus.cc:3037] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:41:08.502875 30473 raft_consensus.cc:3037] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:41:08.504709 30682 raft_consensus.cc:2454] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59bdeae6deca49df825c0296599a0c2b in term 1.
I20260806 18:41:08.505106 30473 raft_consensus.cc:2454] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59bdeae6deca49df825c0296599a0c2b in term 1.
I20260806 18:41:08.505121 30148 leader_election.cc:302] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58963ebe16834e1189d61e0cf39d4e98, 59bdeae6deca49df825c0296599a0c2b; no voters:
I20260806 18:41:08.505329 30786 raft_consensus.cc:2781] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:41:08.505604 30786 raft_consensus.cc:686] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [term 1 LEADER]: Becoming Leader. State: Replica: 59bdeae6deca49df825c0296599a0c2b, State: Running, Role: LEADER
I20260806 18:41:08.506415 30786 consensus_queue.cc:237] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } }
I20260806 18:41:08.511189 30005 catalog_manager.cc:5495] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59bdeae6deca49df825c0296599a0c2b (127.12.177.129). New cstate: current_term: 1 leader_uuid: "59bdeae6deca49df825c0296599a0c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59bdeae6deca49df825c0296599a0c2b" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 } health_report { overall_health: UNKNOWN } } }
I20260806 18:41:08.532455 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.527405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41692 (local address 127.12.177.129:44785)
0806 18:41:08.527588 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 18:41:08.527593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:41:08.527611 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:41:08.527714 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:41:08.527717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:41:08.527789 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:41:08.527910 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:41:08.528254 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.529031 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.530364 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:41:08.530693 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:41:08.530805 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:41:08.531195 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:41:08.531813 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:41:08.531938 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 18:41:08.532068 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 18:41:08.532165 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 18:41:08.542435 30682 raft_consensus.cc:1261] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 1 FOLLOWER]: Refusing update from remote peer 59bdeae6deca49df825c0296599a0c2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:41:08.542438 30473 raft_consensus.cc:1261] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 1 FOLLOWER]: Refusing update from remote peer 59bdeae6deca49df825c0296599a0c2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:41:08.543560 30786 consensus_queue.cc:1035] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "58963ebe16834e1189d61e0cf39d4e98" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:41:08.543922 30797 consensus_queue.cc:1035] T db7c09d7b9b847c5896537c801df2adf P 59bdeae6deca49df825c0296599a0c2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "05bb4a45f4bd4992a345b99b82c2ff59" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 32813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:41:08.561769 30808 mvcc.cc:205] Tried to move back new op lower bound from 7315626674339454976 to 7315626674207350784. Current Snapshot: MvccSnapshot[applied={T|T < 7315626674339454976}]
I20260806 18:41:08.562361 30810 mvcc.cc:205] Tried to move back new op lower bound from 7315626674339454976 to 7315626674207350784. Current Snapshot: MvccSnapshot[applied={T|T < 7315626674339454976}]
I20260806 18:41:08.563340 30804 mvcc.cc:205] Tried to move back new op lower bound from 7315626674339454976 to 7315626674207350784. Current Snapshot: MvccSnapshot[applied={T|T < 7315626674339454976}]
I20260806 18:41:08.578742 30005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:41:08.578994 30005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:41:08.583467 30005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9005eab916814a51a0a240c37ff4c6e0: Sending DeleteTablet for 3 replicas of tablet db7c09d7b9b847c5896537c801df2adf
I20260806 18:41:08.585718 30649 tablet_service.cc:1514] Processing DeleteTablet for tablet db7c09d7b9b847c5896537c801df2adf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:41:08 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:52786
I20260806 18:41:08.586730 30219 tablet_service.cc:1514] Processing DeleteTablet for tablet db7c09d7b9b847c5896537c801df2adf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:41:08 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:41680
I20260806 18:41:08.587630 30446 tablet_service.cc:1514] Processing DeleteTablet for tablet db7c09d7b9b847c5896537c801df2adf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:41:08 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:53920
I20260806 18:41:08.589615 30820 tablet_replica.cc:330] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: stopping tablet replica
I20260806 18:41:08.589774 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 30124
I20260806 18:41:08.590054 30820 raft_consensus.cc:2229] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:41:08.592715 30820 raft_consensus.cc:2258] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:41:08.593492 30822 tablet_replica.cc:330] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: stopping tablet replica
I20260806 18:41:08.593887 30822 raft_consensus.cc:2229] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:41:08.594264 30822 raft_consensus.cc:2258] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:41:08.596416 30820 ts_tablet_manager.cc:1905] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:41:08.601063 30822 ts_tablet_manager.cc:1905] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:41:08.604910 30822 ts_tablet_manager.cc:1918] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:41:08.605054 30822 log.cc:1196] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/db7c09d7b9b847c5896537c801df2adf
I20260806 18:41:08.606525 30820 ts_tablet_manager.cc:1918] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:41:08.606676 30820 log.cc:1196] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/db7c09d7b9b847c5896537c801df2adf
I20260806 18:41:08.607103 30820 ts_tablet_manager.cc:1939] T db7c09d7b9b847c5896537c801df2adf P 58963ebe16834e1189d61e0cf39d4e98: Deleting consensus metadata
I20260806 18:41:08.608753 30822 ts_tablet_manager.cc:1939] T db7c09d7b9b847c5896537c801df2adf P 05bb4a45f4bd4992a345b99b82c2ff59: Deleting consensus metadata
I20260806 18:41:08.608954 29990 catalog_manager.cc:4841] TS 58963ebe16834e1189d61e0cf39d4e98 (127.12.177.131:46283): tablet db7c09d7b9b847c5896537c801df2adf (table test-table [id=33e8f391ce4e4f6e97b255891b8b0fa3]) successfully deleted
I20260806 18:41:08.610291 29990 catalog_manager.cc:4841] TS 05bb4a45f4bd4992a345b99b82c2ff59 (127.12.177.130:32813): tablet db7c09d7b9b847c5896537c801df2adf (table test-table [id=33e8f391ce4e4f6e97b255891b8b0fa3]) successfully deleted
W20260806 18:41:08.615442 29987 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:44785 (error 108)
I20260806 18:41:08.615720 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 30353
I20260806 18:41:08.632593 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:41:08.631836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44785 (local address 127.0.0.1:41700)
0806 18:41:08.632341 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 18:41:08.632465 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388}
W20260806 18:41:08.632980 29987 catalog_manager.cc:4584] TS 59bdeae6deca49df825c0296599a0c2b (127.12.177.129:44785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db7c09d7b9b847c5896537c801df2adf: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44785: connect: Connection refused (error 111)
I20260806 18:41:08.642635 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 30556
I20260806 18:41:08.659145 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 29955
I20260806 18:41:08.679097 12998 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 18:41:09.025166 12998 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 18:41:09.025394 12998 mini_ranger.cc:66] Stopping Ranger...
I20260806 18:41:09.381716 12998 mini_ranger.cc:68] Stopped Ranger
2026-08-06 18:41:09.382 UTC [29309] LOG: received smart shutdown request
2026-08-06 18:41:09.386 UTC [29309] LOG: background worker "logical replication launcher" (PID 29329) exited with exit code 1
2026-08-06 18:41:09.386 UTC [29315] LOG: shutting down
2026-08-06 18:41:09.591 UTC [29309] LOG: database system is shut down
2026-08-06T18:41:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (57927 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:41:09 dist-test-slave-j2vl krb5kdc[30834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:41:09 dist-test-slave-j2vl krb5kdc[30834](info): set up 2 sockets
Aug 06 18:41:09 dist-test-slave-j2vl krb5kdc[30834](info): commencing operation
krb5kdc: starting...
W20260806 18:41:11.041249 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:41:11 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:41:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangeradmin_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangeradmin_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangerlookup_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangerlookup_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
I20260806 18:41:11.261591 12998 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9NHeiD/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/postgres -l logfile start
2026-08-06 18:41:14.524 UTC [30879] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 18:41:14.524 UTC [30879] LOG: listening on IPv4 address "127.12.177.148", port 52899
2026-08-06 18:41:14.532 UTC [30879] LOG: listening on Unix socket "/tmp/.s.PGSQL.52899"
2026-08-06 18:41:14.576 UTC [30882] LOG: database system was shut down at 2026-08-06 18:41:12 UTC
2026-08-06 18:41:14.581 UTC [30879] LOG: database system is ready to accept connections
I20260806 18:41:15.757674 12998 mini_postgres.cc:96] Postgres bound to 52899
2026-08-06 18:41:15.766 UTC [30903] FATAL: database "slave" does not exist
127.12.177.148:52899 - accepting connections
I20260806 18:41:15.766803 12998 mini_ranger.cc:161] Starting Ranger...
I20260806 18:41:15.785490 12998 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 18:41:16.412925 12998 mini_ranger.cc:87] Created ranger Postgres database
I20260806 18:41:16.413013 12998 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin
2026-08-06 18:41:16,710 [I] DB FLAVOR :POSTGRES
2026-08-06 18:41:16,710 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 18:41:16,710 [I] Checking connection..
2026-08-06 18:41:16,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 18:41:17,018 [I] Checking connection passed.
2026-08-06 18:41:17,019 [I] --------- Verifying version history table ---------
2026-08-06 18:41:17,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:41:17,303 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 18:41:17,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:41:17,610 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 18:41:17,611 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 18:41:17,611 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 18:41:17.909 UTC [30995] WARNING: there is no transaction in progress
2026-08-06 18:41:17,920 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 18:41:17,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 18:41:18,198 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 18:41:18,198 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 18:41:18,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 18:41:18,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 18:41:18,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-j2vl.c.gcp-upstream.internal','N') ;"
2026-08-06 18:41:19,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 18:41:19,309 [I] Table x_portal_user does not exist in database ranger
2026-08-06 18:41:19,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 18:41:19,598 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 18:41:19,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 18:41:19,876 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 18:41:20,149 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 18:41:20,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 18:41:21.381 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.402 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.423 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.443 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.465 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.486 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.563 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.574 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.593 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.607 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.623 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.642 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.654 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.662 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.672 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:21.681 UTC [31157] WARNING: there is no transaction in progress
2026-08-06 18:41:22,521 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 18:41:22,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 18:41:22,801 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 18:41:22,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 18:41:23,097 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 18:41:23,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 18:41:23,370 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 18:41:23,370 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 18:41:23,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 18:41:23,945 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-j2vl.c.gcp-upstream.internal';"
2026-08-06 18:41:24,219 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 18:41:24,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 18:41:24,480 [I] DB_PATCHES have already been applied
I20260806 18:41:24.487291 12998 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9NHeiD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 18:41:24.487403 12998 mini_ranger.cc:193] Using host: 127.12.177.148
I20260806 18:41:24.492712 12998 mini_ranger.cc:227] Ranger admin URL: http://127.12.177.148:48263
Aug 06, 2026 6:41:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 6:41:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 6:41:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 6:41:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 6:41:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 6:41:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 6:41:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 18:41:25.932433 12998 mini_ranger.cc:160] Time spent starting Ranger: real 10.166s user 0.000s sys 0.013s
Aug 06, 2026 6:41:50 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 6:41:50 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 6:41:50 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 6:41:50 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 6:41:51 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 18:41:52.144881 12998 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.177.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.177.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangerkms_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.177.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/rangerkms_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.177.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.177.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.177.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/HTTP_127.12.177.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 18:41:52 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041712, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 18:41:52.269549 12998 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 18:41:52.285334 12998 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 18:41:53.437120 12998 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 18:41:53.437203 12998 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms
I20260806 18:41:53.437217 12998 mini_ranger_kms.cc:227] Using postgres at 127.12.177.148:52899
2026-08-06 18:41:53,715 [I] DB FLAVOR :POSTGRES
2026-08-06 18:41:53,715 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 18:41:53,715 [I] Checking connection
2026-08-06 18:41:53,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 18:41:54,004 [I] connection success
2026-08-06 18:41:54,004 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 18:41:54,004 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 18:41:54,004 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 18:41:54,302 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 18:41:54,302 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 18:41:54,302 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 18:41:54,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.177.148:52899/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 18:41:54,621 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 18:41:55.179757 12998 mini_ranger_kms.cc:310] Created kms service
I20260806 18:41:55.428457 12998 mini_ranger_kms.cc:326] Created kudu user
I20260806 18:41:55.492906 12998 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 18:41:55 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041712, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:41:56.018828 12998 mini_ranger_kms.cc:384] Added ranger policy
I20260806 18:41:56.019011 12998 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms:/tmp/dist-test-task9NHeiD/build/debug/bin/postgresql.jar:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9NHeiD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 18:41:56.019037 12998 mini_ranger_kms.cc:240] Using host: 127.12.177.148
I20260806 18:41:56.025681 12998 mini_ranger_kms.cc:276] Ranger KMS PID: 31449
I20260806 18:41:56.025794 12998 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.177.148:50595
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 6:41:57 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 18:41:58 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786041718, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:41:58.863541 12998 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.594s user 0.000s sys 0.262s
I20260806 18:41:58.863685 12998 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 18:41:58.863757 12998 mini_ranger_kms.cc:401] 127.12.177.148:50595/kms/v1/keys
Aug 06 18:41:59 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041718, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
Aug 06 18:41:59 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041718, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.177.148@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
Aug 06 18:42:02 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:42:02.366219 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34087
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34087
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:02.550014 31527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:02.550364 31527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:02.550408 31527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:02.555223 31527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:02.555341 31527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:02.555362 31527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:02.555380 31527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:02.555397 31527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:02.561971 31527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.177.148:50595/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34087
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:02.563313 31527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:02.564808 31527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:02.577075 31533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:02.577230 31527 server_base.cc:1034] running on GCE node
W20260806 18:42:02.577175 31538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:02.577167 31535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:02.578819 31527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:02.580293 31527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:02.581626 31527 hybrid_clock.cc:648] HybridClock initialized: now 1786041722581596 us; error 55 us; skew 500 ppm
Aug 06 18:42:02 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041722, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:02.591078 31527 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:02.592484 31527 webserver.cc:460] Webserver started at http://127.12.177.190:38695/ using document root <none> and password file <none>
I20260806 18:42:02.593158 31527 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:02.593255 31527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:02.593596 31527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:42:02 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041722, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:02.673300 31527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "6d69b52fb8e74b029aa2aa3525876a20"
format_stamp: "Formatted at 2026-08-06 18:42:02 on dist-test-slave-j2vl"
server_key: "e6216035a255876b556fa26902062144"
server_key_iv: "9707756365f6c82c7bfd4dcc1a30bfc1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:02.674113 31527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "6d69b52fb8e74b029aa2aa3525876a20"
format_stamp: "Formatted at 2026-08-06 18:42:02 on dist-test-slave-j2vl"
server_key: "e6216035a255876b556fa26902062144"
server_key_iv: "9707756365f6c82c7bfd4dcc1a30bfc1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:02.678622 31527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260806 18:42:02.700167 31545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:02.701853 31527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:02.702028 31527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "6d69b52fb8e74b029aa2aa3525876a20"
format_stamp: "Formatted at 2026-08-06 18:42:02 on dist-test-slave-j2vl"
server_key: "e6216035a255876b556fa26902062144"
server_key_iv: "9707756365f6c82c7bfd4dcc1a30bfc1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:02.702183 31527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:02.717900 31527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:02.721714 31527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:02.721995 31527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:02.731113 31527 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:34087
I20260806 18:42:02.731133 31627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:34087 every 8 connection(s)
I20260806 18:42:02.732259 31527 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:02.735622 31629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:02.740643 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 31527
I20260806 18:42:02.740808 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:42:02.741130 12998 external_mini_cluster.cc:1428] Setting key cc0b4a1f887fad417f458843282c0b6e
I20260806 18:42:02.743155 31629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Bootstrap starting.
I20260806 18:42:02.746132 31629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:02.747255 31629 log.cc:824] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:02.750208 31629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: No bootstrap required, opened a new log
Aug 06 18:42:02 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:02.755514 31629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:02.755918 31629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:02.756043 31629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d69b52fb8e74b029aa2aa3525876a20, State: Initialized, Role: FOLLOWER
I20260806 18:42:02.756664 31629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:02.756871 31629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:02.756980 31629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:02.757107 31629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:02.758594 31629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:02.759104 31629 leader_election.cc:302] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d69b52fb8e74b029aa2aa3525876a20; no voters:
I20260806 18:42:02.759678 31629 leader_election.cc:288] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:42:02.760107 31636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:02.760423 31636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 LEADER]: Becoming Leader. State: Replica: 6d69b52fb8e74b029aa2aa3525876a20, State: Running, Role: LEADER
I20260806 18:42:02.760828 31636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:02.760922 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:02.742969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49494 (local address 127.12.177.190:34087)
0806 18:42:02.743614 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:02.743635 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:02.743686 (+ 51us) server_negotiation.cc:407] Connection header received
0806 18:42:02.744699 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:02.744729 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:02.745237 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:02.745732 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:02.746845 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:02.748412 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:02.749751 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:02.750550 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:02.750731 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:02.754165 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:02.754174 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:02.754196 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:02.754240 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:02.756489 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:02.757134 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:02.757141 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:02.757149 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:02.757309 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:02.757733 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:02.757736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:02.757738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:02.758362 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:02.759304 (+ 942us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:02.759503 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 18:42:02.759834 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":168,"threads_started":1}
I20260806 18:42:02.761201 31629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:02.762321 31636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d69b52fb8e74b029aa2aa3525876a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } } }
I20260806 18:42:02.762439 31636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:02.762645 31636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d69b52fb8e74b029aa2aa3525876a20. Latest consensus state: current_term: 1 leader_uuid: "6d69b52fb8e74b029aa2aa3525876a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } } }
I20260806 18:42:02.762713 31636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:02.763742 31629 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 18:42:02.764743 31650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:02.779970 31650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:02.789958 31650 catalog_manager.cc:1347] Generated new cluster ID: bdd59c7160784775a760009f88e9c890
I20260806 18:42:02.790148 31650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:02.814105 31650 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:42:02.815621 31650 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:02.822317 31650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Generated new TSK 0
I20260806 18:42:02.823410 31650 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:42:03.677922 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:03.819790 31696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:03.820168 31696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:03.820245 31696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:03.825194 31696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:03.825309 31696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:03.825424 31696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:03.831702 31696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:03.833318 31696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:03.834946 31696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:03.848601 31705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:03.848601 31704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:03.849020 31696 server_base.cc:1034] running on GCE node
W20260806 18:42:03.848726 31709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:03.849659 31696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:03.850477 31696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:03.851689 31696 hybrid_clock.cc:648] HybridClock initialized: now 1786041723851656 us; error 50 us; skew 500 ppm
Aug 06 18:42:03 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041723, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:03.855999 31696 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:03.857424 31696 webserver.cc:460] Webserver started at http://127.12.177.129:44613/ using document root <none> and password file <none>
I20260806 18:42:03.858202 31696 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:03.858296 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:03.858542 31696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:42:03 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041723, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:03.877717 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "97e07cca227c4500adadad46967ffc31"
format_stamp: "Formatted at 2026-08-06 18:42:03 on dist-test-slave-j2vl"
server_key: "01537a4b8ba6a142cee68082a1adefe4"
server_key_iv: "8596a0e8948a31edfa888bc3103947d1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:03.878677 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "97e07cca227c4500adadad46967ffc31"
format_stamp: "Formatted at 2026-08-06 18:42:03 on dist-test-slave-j2vl"
server_key: "01537a4b8ba6a142cee68082a1adefe4"
server_key_iv: "8596a0e8948a31edfa888bc3103947d1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:03.883832 31696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:42:03.904577 31717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:03.906433 31696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:03.906607 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "97e07cca227c4500adadad46967ffc31"
format_stamp: "Formatted at 2026-08-06 18:42:03 on dist-test-slave-j2vl"
server_key: "01537a4b8ba6a142cee68082a1adefe4"
server_key_iv: "8596a0e8948a31edfa888bc3103947d1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:03.906754 31696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:03.933570 31696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:03.944728 31696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:03.945091 31696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:03.946055 31696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:03.947407 31696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:03.947546 31696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 18:42:03.947681 31696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:03.947764 31696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:03.964524 31696 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37079
I20260806 18:42:03.966049 31696 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:03.966118 31887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37079 every 8 connection(s)
I20260806 18:42:03.974754 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 31696
I20260806 18:42:03.974920 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:42:03.975283 12998 external_mini_cluster.cc:1428] Setting key 2b795061a18c8b68e4ccaaa88b87c5ce
Aug 06 18:42:03 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041723, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:03.988801 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:03.970515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:50563 (local address 127.12.177.190:34087)
0806 18:42:03.971451 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:03.971458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:03.971476 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:42:03.973058 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:03.973062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:03.973135 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:03.973231 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:03.975588 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:03.976445 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:03.978910 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:03.979360 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:03.979473 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:03.983218 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:03.983225 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:03.983228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:03.983281 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:03.985565 (+ 2284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:03.986453 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:03.986460 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:03.986462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:03.986580 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:03.987098 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:03.987101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:03.987103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:03.987378 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:03.987477 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:03.988442 (+ 965us) server_negotiation.cc:299] Negotiation successful
0806 18:42:03.988609 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":846,"thread_start_us":108,"threads_started":1}
I20260806 18:42:03.991034 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:03.969114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.129:50563)
0806 18:42:03.971041 (+ 1927us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:03.971120 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:03.972618 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:03.973698 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:03.973712 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:03.974227 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:03.975252 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:03.975303 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:03.976648 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:03.976652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:03.978717 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:03.978736 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:03.979756 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:03.979760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:03.980002 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:03.980811 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:03.980838 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:03.982918 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:03.985774 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:03.985784 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:03.985810 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:03.986299 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:03.986715 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:03.986718 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:03.986721 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:03.986969 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:03.987565 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:03.987575 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:03.988035 (+ 460us) client_negotiation.cc:769] Sending connection context
0806 18:42:03.989373 (+ 1338us) client_negotiation.cc:240] Negotiation successful
0806 18:42:03.989799 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1652,"thread_start_us":227,"threads_started":1}
I20260806 18:42:03.994572 31888 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:03.994908 31888 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:03.995639 31888 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:03.997853 31573 ts_manager.cc:194] Registered new tserver with Master: 97e07cca227c4500adadad46967ffc31 (127.12.177.129:37079)
I20260806 18:42:03.999565 31573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:50563
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:42:04.038539 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 18:42:04.188596 31895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:04.188961 31895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:04.189116 31895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:04.193964 31895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:04.194064 31895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:04.194175 31895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:04.200402 31895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:04.201756 31895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:04.202893 31895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:04.214115 31910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:04.214115 31911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:04.214668 31913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:04.215637 31895 server_base.cc:1034] running on GCE node
I20260806 18:42:04.216192 31895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:04.217010 31895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:04.218201 31895 hybrid_clock.cc:648] HybridClock initialized: now 1786041724218168 us; error 61 us; skew 500 ppm
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:04.222225 31895 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:04.223593 31895 webserver.cc:460] Webserver started at http://127.12.177.130:36591/ using document root <none> and password file <none>
I20260806 18:42:04.224467 31895 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:04.224577 31895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:04.224864 31895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:04.244702 31895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "ff87214d3d6b4c1da06e0d798f6fcfef"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "9bcf5887d1c72f9964be201b25a7df87"
server_key_iv: "a059c2ae34d2c426c0622874c614f473"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.245687 31895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "ff87214d3d6b4c1da06e0d798f6fcfef"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "9bcf5887d1c72f9964be201b25a7df87"
server_key_iv: "a059c2ae34d2c426c0622874c614f473"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.251305 31895 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:42:04.280311 31927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.282424 31895 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260806 18:42:04.282585 31895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "ff87214d3d6b4c1da06e0d798f6fcfef"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "9bcf5887d1c72f9964be201b25a7df87"
server_key_iv: "a059c2ae34d2c426c0622874c614f473"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.282757 31895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:04.305420 31895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:04.309854 31895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:04.310117 31895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:04.310938 31895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:04.312125 31895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:04.312189 31895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.312250 31895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:04.312279 31895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.326397 31895 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:36639
I20260806 18:42:04.327898 31895 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:04.330092 32094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:36639 every 8 connection(s)
I20260806 18:42:04.334256 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 31895
I20260806 18:42:04.334434 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:42:04.334815 12998 external_mini_cluster.cc:1428] Setting key b1e572adfbed05b34e940a310f8df5ad
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:04.356088 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:04.333303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:54347 (local address 127.12.177.190:34087)
0806 18:42:04.333497 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:04.333502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:04.336047 (+ 2545us) server_negotiation.cc:407] Connection header received
0806 18:42:04.337550 (+ 1503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:04.337555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:04.337627 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:04.337689 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:04.339695 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.340547 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.342577 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.342975 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.343072 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:04.350744 (+ 7672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:04.350751 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:04.350754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:04.350794 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:04.352868 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:04.353766 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:04.353771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:04.353773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:04.353888 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:04.354433 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:04.354437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:04.354439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:04.354711 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:04.354828 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:04.355676 (+ 848us) server_negotiation.cc:299] Negotiation successful
0806 18:42:04.355856 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 18:42:04.358148 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:04.332841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.130:54347)
0806 18:42:04.335838 (+ 2997us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:04.335919 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:04.337196 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:04.338208 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:04.338220 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:04.338649 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:04.339475 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:04.339501 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.340736 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.340740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:04.342383 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:04.342398 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.347146 (+ 4748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.347153 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:04.347463 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:04.348383 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:04.348413 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:04.350449 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:04.353066 (+ 2617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:04.353074 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:04.353095 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:04.353614 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:04.354024 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:04.354028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:04.354030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:04.354296 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:04.354912 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:04.354920 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:04.355337 (+ 417us) client_negotiation.cc:769] Sending connection context
0806 18:42:04.356401 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0806 18:42:04.356857 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2691,"thread_start_us":201,"threads_started":1}
I20260806 18:42:04.360066 32097 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:04.360368 32097 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:04.361095 32097 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:04.362473 31573 ts_manager.cc:194] Registered new tserver with Master: ff87214d3d6b4c1da06e0d798f6fcfef (127.12.177.130:36639)
I20260806 18:42:04.363291 31573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:54347
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:42:04.413203 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:04.618836 32103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:04.619253 32103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:04.619360 32103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:04.629870 32103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:04.629978 32103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:04.630089 32103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:04.638896 32103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:04.640602 32103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:04.642271 32103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:04.659446 32114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:04.659996 32111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:04.660842 32103 server_base.cc:1034] running on GCE node
W20260806 18:42:04.663622 32109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:04.664409 32103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:04.665721 32103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:04.667050 32103 hybrid_clock.cc:648] HybridClock initialized: now 1786041724666943 us; error 122 us; skew 500 ppm
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:04.675913 32103 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:04.680217 32103 webserver.cc:460] Webserver started at http://127.12.177.131:41229/ using document root <none> and password file <none>
I20260806 18:42:04.695029 32103 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:04.695195 32103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:04.695662 32103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:04.719025 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "e48991ceca97449c9b7b574f0e34ee06"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "0dc2147484d93b63b3ff6e7c50313ed2"
server_key_iv: "2aa14ea3a3db191f9d1f946cb3dacf1d"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.720157 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "e48991ceca97449c9b7b574f0e34ee06"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "0dc2147484d93b63b3ff6e7c50313ed2"
server_key_iv: "2aa14ea3a3db191f9d1f946cb3dacf1d"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.736855 32103 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.004s sys 0.000s
I20260806 18:42:04.756297 32123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.758319 32103 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260806 18:42:04.758503 32103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "e48991ceca97449c9b7b574f0e34ee06"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "0dc2147484d93b63b3ff6e7c50313ed2"
server_key_iv: "2aa14ea3a3db191f9d1f946cb3dacf1d"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:04.758665 32103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:04.792447 32103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:04.796491 32103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:04.796703 32103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:04.797433 32103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:04.798511 32103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:04.798575 32103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.798632 32103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:04.798661 32103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:04.809715 32103 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:46809
I20260806 18:42:04.810932 32103 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:04.811553 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 32103
I20260806 18:42:04.811681 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:42:04.811995 12998 external_mini_cluster.cc:1428] Setting key 27e83e5eaef3114999d544567a1b14f8
I20260806 18:42:04.822723 32297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:46809 every 8 connection(s)
Aug 06 18:42:04 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041724, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:04.846716 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:04.825146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:56125 (local address 127.12.177.190:34087)
0806 18:42:04.825294 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:04.825299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:04.830091 (+ 4792us) server_negotiation.cc:407] Connection header received
0806 18:42:04.831492 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:04.831496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:04.831565 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:04.831619 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:04.833530 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.834384 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.836217 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.836574 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.836655 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:04.841982 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:04.841987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:04.841990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:04.842025 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:04.843783 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:04.844537 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:04.844540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:04.844542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:04.844639 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:04.845094 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:04.845097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:04.845099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:04.845384 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:04.845484 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:04.846382 (+ 898us) server_negotiation.cc:299] Negotiation successful
0806 18:42:04.846537 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:42:04.848814 32302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:04.825745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.131:56125)
0806 18:42:04.829851 (+ 4106us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:04.829951 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:04.831193 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:04.832113 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:04.832124 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:04.832544 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:04.833282 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:04.833302 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.834573 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.834576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:04.836054 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:04.836068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:04.836891 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:04.836894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:04.838989 (+ 2095us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:04.839789 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:04.839814 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:04.841704 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:04.843979 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:04.843987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:04.844009 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:04.844393 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:04.844752 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:04.844755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:04.844757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:04.844978 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:04.845658 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:04.845665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:04.846075 (+ 410us) client_negotiation.cc:769] Sending connection context
0806 18:42:04.847049 (+ 974us) client_negotiation.cc:240] Negotiation successful
0806 18:42:04.847469 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3784,"thread_start_us":172,"threads_started":1}
I20260806 18:42:04.852102 32298 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:04.852401 32298 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:04.853113 32298 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:04.854280 31573 ts_manager.cc:194] Registered new tserver with Master: e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809)
I20260806 18:42:04.855086 31573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:56125
I20260806 18:42:04.862769 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:04.863718 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 31696
I20260806 18:42:04.884550 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 31895
I20260806 18:42:04.904676 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 32103
I20260806 18:42:04.916764 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 31527
I20260806 18:42:04.932788 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34087
--webserver_interface=127.12.177.190
--webserver_port=38695
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34087
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:05.065609 32303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:05.065960 32303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:05.066005 32303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:05.071122 32303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:05.071288 32303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:05.071332 32303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:05.071377 32303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:05.071419 32303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:05.078142 32303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34087
--ranger_config_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=38695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:05.079680 32303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:05.081663 32303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:05.091961 32314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:05.091988 32310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:05.092240 32303 server_base.cc:1034] running on GCE node
W20260806 18:42:05.091959 32312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:05.093005 32303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:05.094444 32303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:05.095672 32303 hybrid_clock.cc:648] HybridClock initialized: now 1786041725095640 us; error 70 us; skew 500 ppm
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:05.099756 32303 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:05.101233 32303 webserver.cc:460] Webserver started at http://127.12.177.190:38695/ using document root <none> and password file <none>
I20260806 18:42:05.101995 32303 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:05.102126 32303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:05.182368 32303 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:42:05.184864 32324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.186414 32303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:05.186631 32303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "6d69b52fb8e74b029aa2aa3525876a20"
format_stamp: "Formatted at 2026-08-06 18:42:02 on dist-test-slave-j2vl"
server_key: "e6216035a255876b556fa26902062144"
server_key_iv: "9707756365f6c82c7bfd4dcc1a30bfc1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:05.187240 32303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:05.202445 32303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:05.205955 32303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:05.206192 32303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:05.214612 32303 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:34087
I20260806 18:42:05.214620 32412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:34087 every 8 connection(s)
I20260806 18:42:05.215973 32303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:05.221107 32413 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:42:05.223134 32413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Bootstrap starting.
I20260806 18:42:05.224511 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 32303
I20260806 18:42:05.225149 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:37079
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:34087
--webserver_port=44613
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:05.242144 32413 log.cc:824] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:05.249856 32413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:05.250339 32413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Bootstrap complete.
I20260806 18:42:05.255431 32413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:05.255878 32413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d69b52fb8e74b029aa2aa3525876a20, State: Initialized, Role: FOLLOWER
I20260806 18:42:05.256495 32413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:05.256629 32413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:05.256726 32413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:05.256842 32413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:42:05.259218 32413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:05.259640 32413 leader_election.cc:302] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d69b52fb8e74b029aa2aa3525876a20; no voters:
I20260806 18:42:05.260018 32413 leader_election.cc:288] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 18:42:05.260178 32421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 18:42:05.260427 32421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [term 2 LEADER]: Becoming Leader. State: Replica: 6d69b52fb8e74b029aa2aa3525876a20, State: Running, Role: LEADER
I20260806 18:42:05.260990 32421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } }
I20260806 18:42:05.261533 32413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:05.262638 32422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6d69b52fb8e74b029aa2aa3525876a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } } }
I20260806 18:42:05.262785 32422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:05.263115 32423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d69b52fb8e74b029aa2aa3525876a20. Latest consensus state: current_term: 2 leader_uuid: "6d69b52fb8e74b029aa2aa3525876a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d69b52fb8e74b029aa2aa3525876a20" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34087 } } }
I20260806 18:42:05.263211 32423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:05.263738 32433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:05.264156 32413 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 18:42:05.270927 32433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:05.272094 32433 catalog_manager.cc:1259] Loaded cluster ID: bdd59c7160784775a760009f88e9c890
I20260806 18:42:05.272174 32433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:05.276073 32433 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:05.277031 32433 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Loaded TSK: 0
I20260806 18:42:05.279562 32433 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:42:05.387658 32416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:05.388064 32416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:05.388142 32416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:05.394547 32416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:05.394656 32416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:05.394766 32416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:05.403136 32416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:37079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=44613
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:05.404662 32416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:05.406203 32416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:05.423286 32479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:05.423290 32477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:05.424353 32476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:05.424955 32416 server_base.cc:1034] running on GCE node
I20260806 18:42:05.425552 32416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:05.426509 32416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:05.427735 32416 hybrid_clock.cc:648] HybridClock initialized: now 1786041725427708 us; error 43 us; skew 500 ppm
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:05.433372 32416 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:05.434904 32416 webserver.cc:460] Webserver started at http://127.12.177.129:44613/ using document root <none> and password file <none>
I20260806 18:42:05.435722 32416 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:05.435856 32416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:05.481731 32416 fs_manager.cc:709] Time spent opening directory manager: real 0.018s user 0.004s sys 0.000s
I20260806 18:42:05.485152 32489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.486913 32416 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 18:42:05.487082 32416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "97e07cca227c4500adadad46967ffc31"
format_stamp: "Formatted at 2026-08-06 18:42:03 on dist-test-slave-j2vl"
server_key: "01537a4b8ba6a142cee68082a1adefe4"
server_key_iv: "8596a0e8948a31edfa888bc3103947d1"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:05.487855 32416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:05.554159 32416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:05.558316 32416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:05.558565 32416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:05.559345 32416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:05.560652 32416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:05.560729 32416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.560801 32416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:05.560840 32416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.575181 32416 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:37079
I20260806 18:42:05.576797 32416 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:05.577095 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 32416
I20260806 18:42:05.577757 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:36639
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:34087
--webserver_port=36591
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:05.577838 32651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:37079 every 8 connection(s)
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:05.613315 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:05.583353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.129:33143)
0806 18:42:05.585947 (+ 2594us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:05.586070 (+ 123us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:05.587269 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:05.592282 (+ 5013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:05.592293 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:05.592755 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:05.593581 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:05.593606 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.596534 (+ 2928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.596541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:05.598453 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:05.598474 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.601429 (+ 2955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.601438 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:05.601704 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:05.602538 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:05.602568 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:05.604460 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:05.607821 (+ 3361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:05.607834 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:05.607860 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:05.608436 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:05.609062 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:05.609068 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:05.609073 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:05.609383 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:05.610641 (+ 1258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:05.610653 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:05.611132 (+ 479us) client_negotiation.cc:769] Sending connection context
0806 18:42:05.611424 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 18:42:05.611972 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2290,"thread_start_us":2071,"threads_started":1}
I20260806 18:42:05.615773 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:05.587290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:33143 (local address 127.12.177.190:34087)
0806 18:42:05.588249 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:05.588272 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:05.588317 (+ 45us) server_negotiation.cc:407] Connection header received
0806 18:42:05.588638 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:05.588653 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:05.589112 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:05.591671 (+ 2559us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:05.594103 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.596281 (+ 2178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.598697 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.600813 (+ 2116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.601066 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:05.604826 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:05.604833 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:05.604856 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:05.604902 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:05.607590 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:05.608647 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:05.608659 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:05.608670 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:05.608909 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:05.609534 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:05.609541 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:05.609546 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:05.610286 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:05.610465 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:05.614169 (+ 3704us) server_negotiation.cc:299] Negotiation successful
0806 18:42:05.614562 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":791,"thread_start_us":149,"threads_started":1}
I20260806 18:42:05.620062 32652 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:05.620369 32652 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.621122 32652 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
W20260806 18:42:05.624212 32652 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:34087 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 18:42:05.624378 32652 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.624686 32652 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:05.626132 32652 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.626381 32652 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
W20260806 18:42:05.627426 32652 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:42:05.760784 32657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:05.761260 32657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:05.761370 32657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:05.768247 32657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:05.768343 32657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:05.768430 32657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:05.776616 32657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:36639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=36591
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:05.778213 32657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:05.779726 32657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:05.793033 32667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:05.793295 32665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:05.793140 32664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:05.793717 32657 server_base.cc:1034] running on GCE node
I20260806 18:42:05.794296 32657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:05.795301 32657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:05.796481 32657 hybrid_clock.cc:648] HybridClock initialized: now 1786041725796460 us; error 43 us; skew 500 ppm
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:05.802287 32657 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:05.803929 32657 webserver.cc:460] Webserver started at http://127.12.177.130:36591/ using document root <none> and password file <none>
I20260806 18:42:05.804947 32657 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:05.805169 32657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:05.827538 32657 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:42:05.831362 32687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.833070 32657 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 18:42:05.833246 32657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "ff87214d3d6b4c1da06e0d798f6fcfef"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "9bcf5887d1c72f9964be201b25a7df87"
server_key_iv: "a059c2ae34d2c426c0622874c614f473"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:05.833967 32657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:05.848296 32657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:05.853055 32657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:05.853317 32657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:05.854386 32657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:05.855561 32657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:05.855619 32657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.855665 32657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:05.855686 32657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:05.867784 32657 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:36639
I20260806 18:42:05.867967 392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:36639 every 8 connection(s)
I20260806 18:42:05.869240 32657 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:05.870208 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 32657
I20260806 18:42:05.870715 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.177.148:50595/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:46809
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:34087
--webserver_port=41229
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:42:05 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041725, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:05.891199 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:05.874504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45055 (local address 127.12.177.190:34087)
0806 18:42:05.874694 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:05.874700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:05.874742 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:42:05.875476 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:05.875480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:05.875560 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:05.875687 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:05.877469 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.878378 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.880617 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.881078 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.881191 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:05.885245 (+ 4054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:05.885253 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:05.885258 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:05.885318 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:05.887642 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:05.888886 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:05.888891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:05.888894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:05.889002 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:05.889517 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:05.889521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:05.889523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:05.889793 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:05.889886 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:05.890822 (+ 936us) server_negotiation.cc:299] Negotiation successful
0806 18:42:05.891002 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 18:42:05.893960 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:05.872841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.130:45055)
0806 18:42:05.873515 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:05.873581 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:05.875206 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:05.875946 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:05.875958 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:05.876384 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:05.877184 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:05.877210 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.878604 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.878610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:05.880398 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:05.880419 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:05.881530 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:05.881538 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:05.881829 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:05.882630 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:05.882662 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:05.884901 (+ 2239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:05.887867 (+ 2966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:05.887877 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:05.887903 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:05.888726 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:05.889121 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:05.889124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:05.889126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:05.889395 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:05.889964 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:05.889973 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:05.890369 (+ 396us) client_negotiation.cc:769] Sending connection context
0806 18:42:05.891683 (+ 1314us) client_negotiation.cc:240] Negotiation successful
0806 18:42:05.892175 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":194,"threads_started":1}
I20260806 18:42:05.895794 394 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:05.896032 394 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.896715 394 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
W20260806 18:42:05.899139 394 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:34087 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 18:42:05.899291 394 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.899505 394 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:05.900571 394 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:05.900779 394 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
W20260806 18:42:05.901672 394 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:42:06.033181 396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:06.033834 396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:06.033951 396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:06.040676 396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:06.040762 396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:06.040834 396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:06.047976 396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.177.148:50595/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:46809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=41229
--tserver_master_addrs=127.12.177.190:34087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:06.049521 396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:06.050926 396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:06.065183 403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:06.066219 406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:06.065555 404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:06.068265 396 server_base.cc:1034] running on GCE node
I20260806 18:42:06.068948 396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:06.069959 396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:06.073331 396 hybrid_clock.cc:648] HybridClock initialized: now 1786041726073326 us; error 130 us; skew 500 ppm
Aug 06 18:42:06 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:06.077682 396 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:06.079046 396 webserver.cc:460] Webserver started at http://127.12.177.131:41229/ using document root <none> and password file <none>
I20260806 18:42:06.079906 396 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:06.080036 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 18:42:06 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:06.100932 396 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 18:42:06.106360 419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:06.108321 396 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 18:42:06.108485 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "e48991ceca97449c9b7b574f0e34ee06"
format_stamp: "Formatted at 2026-08-06 18:42:04 on dist-test-slave-j2vl"
server_key: "0dc2147484d93b63b3ff6e7c50313ed2"
server_key_iv: "2aa14ea3a3db191f9d1f946cb3dacf1d"
server_key_version: "kuduclusterkey@0"
I20260806 18:42:06.109738 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:06.153505 396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:06.158733 396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:06.159006 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:06.159855 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:06.161083 396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:06.161158 396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:06.161221 396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:06.161273 396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:06.175853 396 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:46809
I20260806 18:42:06.176256 597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:46809 every 8 connection(s)
I20260806 18:42:06.177130 396 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:06.183815 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 396
Aug 06 18:42:06 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:06.197679 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.179331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:53457 (local address 127.12.177.190:34087)
0806 18:42:06.179512 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.179517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.180609 (+ 1092us) server_negotiation.cc:407] Connection header received
0806 18:42:06.181693 (+ 1084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.181698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.181760 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.181876 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:06.183193 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.184067 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.186511 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.186832 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.187042 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.192329 (+ 5287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:06.192335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:06.192342 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:06.192404 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:06.194142 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.195216 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.195220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.195223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.195323 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.195851 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.195853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.195855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.196329 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:06.196417 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.197275 (+ 858us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.197472 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"spinlock_wait_cycles":6912}
I20260806 18:42:06.198103 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.184717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53074 (local address 127.12.177.190:34087)
0806 18:42:06.185139 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.185149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.185165 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:42:06.185307 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.185310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.185402 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.185502 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:06.186581 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.187401 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.188801 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.189077 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.189198 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.191748 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:06.191751 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:06.191753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:06.191784 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:06.195239 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.195849 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.195853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.195855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.196159 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.196538 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.196541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.196543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.196737 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:06.196961 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.197770 (+ 809us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.197916 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"spinlock_wait_cycles":8192,"thread_start_us":157,"threads_started":1}
I20260806 18:42:06.200034 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.179837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34087 (local address 127.12.177.131:53457)
0806 18:42:06.180376 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:06.180437 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:06.181454 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:06.182117 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:06.182125 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:06.182433 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:06.182985 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.183001 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.184250 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.184254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.186290 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.186306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.187620 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.187627 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.187877 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.189496 (+ 1619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:06.189525 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:06.191545 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:06.194311 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:06.194320 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:06.194346 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:06.195048 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:06.195449 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:06.195452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:06.195454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:06.195706 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:06.196521 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:06.196530 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:06.196944 (+ 414us) client_negotiation.cc:769] Sending connection context
0806 18:42:06.198387 (+ 1443us) client_negotiation.cc:240] Negotiation successful
0806 18:42:06.198873 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":162,"threads_started":1}
I20260806 18:42:06.201390 598 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34087
I20260806 18:42:06.201670 598 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:06.202265 598 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:06.203787 32349 ts_manager.cc:194] Registered new tserver with Master: e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809)
I20260806 18:42:06.205076 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:53457
Aug 06 18:42:06 dist-test-slave-j2vl krb5kdc[30834](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:06.627735 32652 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:06.628104 32652 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:06.629076 32349 ts_manager.cc:194] Registered new tserver with Master: 97e07cca227c4500adadad46967ffc31 (127.12.177.129:37079)
I20260806 18:42:06.630120 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:33143
I20260806 18:42:06.901979 394 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:06.902318 394 heartbeater.cc:511] Master 127.12.177.190:34087 requested a full tablet report, sending...
I20260806 18:42:06.903277 32349 ts_manager.cc:194] Registered new tserver with Master: ff87214d3d6b4c1da06e0d798f6fcfef (127.12.177.130:36639)
I20260806 18:42:06.904090 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:45055
I20260806 18:42:06.909650 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:06.922032 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.911452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53078 (local address 127.12.177.190:34087)
0806 18:42:06.911715 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.911720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.911773 (+ 53us) server_negotiation.cc:407] Connection header received
0806 18:42:06.911924 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.911928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.911985 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.912099 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:06.912947 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.913807 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.915033 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.915398 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.915514 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.917526 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:06.917530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:06.917532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:06.917567 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:06.919710 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.920337 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.920340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.920342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.920455 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:06.920765 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:06.920768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:06.920770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:06.921014 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:06.921149 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.921499 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.921648 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":74,"threads_started":1}
I20260806 18:42:06.926826 32349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:42:06.932008 32349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 06 18:42:06 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:06.962432 631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.951433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:46809 (local address 127.0.0.1:33934)
0806 18:42:06.954293 (+ 2860us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:06.954365 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:06.954529 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:06.955854 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:06.955861 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:06.955891 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:06.956068 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.956077 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.957647 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.957651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.959193 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.959211 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.961750 (+ 2539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.961753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.961921 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.961972 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 18:42:06.962085 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 18:42:06.962241 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2669,"spinlock_wait_cycles":2176,"thread_start_us":114,"threads_started":1}
I20260806 18:42:06.965018 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.952149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33934 (local address 127.12.177.131:46809)
0806 18:42:06.954857 (+ 2708us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.954866 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.954894 (+ 28us) server_negotiation.cc:407] Connection header received
0806 18:42:06.955011 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.955017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.955427 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.955621 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:06.956232 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.957478 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.959824 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.961371 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.961508 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.961689 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.964666 (+ 2977us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.964836 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2594,"thread_start_us":82,"threads_started":1}
I20260806 18:42:06.969465 480 tablet_service.cc:1467] Processing CreateTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf (DEFAULT_TABLE table=test-table [id=fefa2c342a7b405ea56794fb5cb82379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:06.970957 480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3226e8c843a43b7a6d08c1707d5b0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:06.974184 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.953595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37079 (local address 127.0.0.1:44200)
0806 18:42:06.959533 (+ 5938us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:06.959551 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:06.959675 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:06.961688 (+ 2013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:06.961692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:06.961718 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:06.961823 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.961829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.968937 (+ 7108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.968941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.971695 (+ 2754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.971717 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.973618 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.973634 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.973757 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.973792 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 18:42:06.973897 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 18:42:06.973995 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5844,"thread_start_us":106,"threads_started":1}
I20260806 18:42:06.975128 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.954029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.12.177.129:37079)
0806 18:42:06.954857 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.954866 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.960668 (+ 5802us) server_negotiation.cc:407] Connection header received
0806 18:42:06.960786 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.960796 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.961461 (+ 665us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.961954 (+ 493us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:06.962129 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.964363 (+ 2234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.971979 (+ 7616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.973032 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.973205 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.973389 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.974831 (+ 1442us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.974963 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":103,"threads_started":1}
I20260806 18:42:06.978880 32533 tablet_service.cc:1467] Processing CreateTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf (DEFAULT_TABLE table=test-table [id=fefa2c342a7b405ea56794fb5cb82379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:06.980206 32533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3226e8c843a43b7a6d08c1707d5b0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:06.993848 643 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Bootstrap starting.
I20260806 18:42:06.994418 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.951084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:36639 (local address 127.0.0.1:52950)
0806 18:42:06.954320 (+ 3236us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:06.954365 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:06.954529 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:06.966543 (+ 12014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:06.966547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:06.966578 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:06.966703 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.966710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.990931 (+ 24221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.990937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.992094 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:06.992110 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.993910 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.993915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:06.994039 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.994085 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 18:42:06.994148 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 18:42:06.994242 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2768,"spinlock_wait_cycles":8192,"thread_start_us":117,"threads_started":1}
I20260806 18:42:06.995868 634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:06.952164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.12.177.130:36639)
0806 18:42:06.962997 (+ 10833us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:06.963005 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:06.963034 (+ 29us) server_negotiation.cc:407] Connection header received
0806 18:42:06.963122 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:06.963128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:06.963367 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:06.966903 (+ 3536us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:06.967103 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.990786 (+ 23683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.992357 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:06.993300 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:06.995339 (+ 2039us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:06.995512 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:06.995576 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 18:42:06.995690 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10695,"thread_start_us":123,"threads_started":1}
I20260806 18:42:06.997112 643 tablet_bootstrap.cc:654] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:06.999445 643 log.cc:824] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:07.000397 644 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Bootstrap starting.
I20260806 18:42:07.000793 32760 tablet_service.cc:1467] Processing CreateTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf (DEFAULT_TABLE table=test-table [id=fefa2c342a7b405ea56794fb5cb82379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:07.002151 32760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3226e8c843a43b7a6d08c1707d5b0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:07.003100 644 tablet_bootstrap.cc:654] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:07.004056 644 log.cc:824] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:07.007766 643 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: No bootstrap required, opened a new log
I20260806 18:42:07.008246 643 ts_tablet_manager.cc:1397] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.005s
I20260806 18:42:07.013679 643 raft_consensus.cc:348] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.014081 643 raft_consensus.cc:374] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:07.014137 643 raft_consensus.cc:729] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48991ceca97449c9b7b574f0e34ee06, State: Initialized, Role: FOLLOWER
I20260806 18:42:07.014876 643 consensus_queue.cc:260] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.016426 643 ts_tablet_manager.cc:1428] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 18:42:07.016927 598 heartbeater.cc:503] Master 127.12.177.190:34087 was elected leader, sending a full tablet report...
I20260806 18:42:07.019654 644 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: No bootstrap required, opened a new log
I20260806 18:42:07.019927 644 ts_tablet_manager.cc:1397] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260806 18:42:07.024765 644 raft_consensus.cc:348] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.025298 644 raft_consensus.cc:374] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:07.025403 644 raft_consensus.cc:729] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e07cca227c4500adadad46967ffc31, State: Initialized, Role: FOLLOWER
I20260806 18:42:07.026051 644 consensus_queue.cc:260] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.027642 644 ts_tablet_manager.cc:1428] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 18:42:07.028083 32652 heartbeater.cc:503] Master 127.12.177.190:34087 was elected leader, sending a full tablet report...
I20260806 18:42:07.034219 652 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Bootstrap starting.
I20260806 18:42:07.037645 652 tablet_bootstrap.cc:654] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:07.038722 652 log.cc:824] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:07.045120 652 tablet_bootstrap.cc:492] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: No bootstrap required, opened a new log
I20260806 18:42:07.045650 652 ts_tablet_manager.cc:1397] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260806 18:42:07.051429 652 raft_consensus.cc:348] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.051819 652 raft_consensus.cc:374] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:07.051888 652 raft_consensus.cc:729] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff87214d3d6b4c1da06e0d798f6fcfef, State: Initialized, Role: FOLLOWER
I20260806 18:42:07.052469 652 consensus_queue.cc:260] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.053376 394 heartbeater.cc:503] Master 127.12.177.190:34087 was elected leader, sending a full tablet report...
I20260806 18:42:07.053798 652 ts_tablet_manager.cc:1428] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
W20260806 18:42:07.080545 32655 tablet.cc:2369] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:07.124326 395 tablet.cc:2369] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:07.180090 600 tablet.cc:2369] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 18:42:07 dist-test-slave-j2vl krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041726, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for HTTP/127.12.177.148@KRBTEST.COM
I20260806 18:42:07.325592 654 raft_consensus.cc:482] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:07.325908 654 raft_consensus.cc:504] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.327586 654 leader_election.cc:288] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff87214d3d6b4c1da06e0d798f6fcfef (127.12.177.130:36639), e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809)
I20260806 18:42:07.330751 656 raft_consensus.cc:482] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:07.331236 656 raft_consensus.cc:504] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.332823 656 leader_election.cc:288] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809), 97e07cca227c4500adadad46967ffc31 (127.12.177.129:37079)
I20260806 18:42:07.337889 634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.329829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:41423 (local address 127.12.177.130:36639)
0806 18:42:07.330168 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:07.330173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:07.332233 (+ 2060us) server_negotiation.cc:407] Connection header received
0806 18:42:07.332460 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:07.332463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:07.332517 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:07.332570 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:07.333155 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.333954 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.336289 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.336879 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.336987 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.337045 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:07.337656 (+ 611us) server_negotiation.cc:299] Negotiation successful
0806 18:42:07.337745 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243}
I20260806 18:42:07.338553 659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.328193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:36639 (local address 127.12.177.129:41423)
0806 18:42:07.332124 (+ 3931us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:07.332150 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:07.332335 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:07.332735 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:07.332741 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:07.332771 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:07.333009 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.333019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.334809 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.334812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.336110 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.336125 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.337164 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.337168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.337278 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.337317 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 18:42:07.338271 (+ 954us) client_negotiation.cc:240] Negotiation successful
0806 18:42:07.338381 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2141,"thread_start_us":277,"threads_started":1}
I20260806 18:42:07.340016 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "97e07cca227c4500adadad46967ffc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" is_pre_election: true
I20260806 18:42:07.340323 328 raft_consensus.cc:2454] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e07cca227c4500adadad46967ffc31 in term 0.
I20260806 18:42:07.340890 32490 leader_election.cc:302] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e07cca227c4500adadad46967ffc31, ff87214d3d6b4c1da06e0d798f6fcfef; no voters:
I20260806 18:42:07.341248 654 raft_consensus.cc:2781] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:07.341411 654 raft_consensus.cc:482] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:07.341475 654 raft_consensus.cc:3037] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:07.343001 654 raft_consensus.cc:504] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.343472 654 leader_election.cc:288] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [CANDIDATE]: Term 1 election: Requested vote from peers ff87214d3d6b4c1da06e0d798f6fcfef (127.12.177.130:36639), e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809)
I20260806 18:42:07.344254 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "97e07cca227c4500adadad46967ffc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef"
I20260806 18:42:07.344409 328 raft_consensus.cc:3037] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:07.346181 328 raft_consensus.cc:2454] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e07cca227c4500adadad46967ffc31 in term 1.
I20260806 18:42:07.346740 32490 leader_election.cc:302] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e07cca227c4500adadad46967ffc31, ff87214d3d6b4c1da06e0d798f6fcfef; no voters:
I20260806 18:42:07.347076 654 raft_consensus.cc:2781] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:07.347365 654 raft_consensus.cc:686] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [term 1 LEADER]: Becoming Leader. State: Replica: 97e07cca227c4500adadad46967ffc31, State: Running, Role: LEADER
I20260806 18:42:07.347923 654 consensus_queue.cc:237] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } }
I20260806 18:42:07.350759 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.330006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:51077 (local address 127.12.177.131:46809)
0806 18:42:07.330686 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:07.330691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:07.337722 (+ 7031us) server_negotiation.cc:407] Connection header received
0806 18:42:07.338002 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:07.338005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:07.338060 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:07.338108 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:07.338614 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.339361 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.348579 (+ 9218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.349284 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.349442 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.349507 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:07.350505 (+ 998us) server_negotiation.cc:299] Negotiation successful
0806 18:42:07.350614 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575}
I20260806 18:42:07.351258 660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.328869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:46809 (local address 127.12.177.129:51077)
0806 18:42:07.337618 (+ 8749us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:07.337634 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:07.337811 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:07.338336 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:07.338339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:07.338359 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:07.338480 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.338486 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.339734 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.339738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.347955 (+ 8217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.347969 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.349629 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.349633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.349745 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.349773 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 18:42:07.351011 (+ 1238us) client_negotiation.cc:240] Negotiation successful
0806 18:42:07.351106 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8564,"thread_start_us":159,"threads_started":1}
I20260806 18:42:07.352296 528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "97e07cca227c4500adadad46967ffc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48991ceca97449c9b7b574f0e34ee06" is_pre_election: true
I20260806 18:42:07.352658 528 raft_consensus.cc:2454] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e07cca227c4500adadad46967ffc31 in term 0.
I20260806 18:42:07.353018 527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "97e07cca227c4500adadad46967ffc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48991ceca97449c9b7b574f0e34ee06"
I20260806 18:42:07.353129 527 raft_consensus.cc:3037] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:07.355043 527 raft_consensus.cc:2454] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e07cca227c4500adadad46967ffc31 in term 1.
I20260806 18:42:07.355284 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.334554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:49317 (local address 127.12.177.129:37079)
0806 18:42:07.334687 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:07.334691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:07.348365 (+ 13674us) server_negotiation.cc:407] Connection header received
0806 18:42:07.349928 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:07.349932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:07.349989 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:07.350036 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:07.351463 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.352208 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.353885 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.354485 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.354592 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.354646 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:07.355059 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 18:42:07.355152 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:42:07.355697 662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.333948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37079 (local address 127.12.177.130:49317)
0806 18:42:07.348272 (+ 14324us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:07.348287 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:07.348444 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:07.350178 (+ 1734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:07.350181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:07.350201 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:07.350342 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.350349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.352372 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.352376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.353721 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.353736 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.354784 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.354788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.354898 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.354924 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 18:42:07.355444 (+ 520us) client_negotiation.cc:240] Negotiation successful
0806 18:42:07.355537 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14249,"thread_start_us":90,"threads_started":1}
I20260806 18:42:07.356715 32587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e07cca227c4500adadad46967ffc31" is_pre_election: true
I20260806 18:42:07.359941 32349 catalog_manager.cc:5495] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97e07cca227c4500adadad46967ffc31 (127.12.177.129). New cstate: current_term: 1 leader_uuid: "97e07cca227c4500adadad46967ffc31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e07cca227c4500adadad46967ffc31" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 37079 } health_report { overall_health: HEALTHY } } }
I20260806 18:42:07.368952 663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.333506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:46809 (local address 127.12.177.130:32787)
0806 18:42:07.347299 (+ 13793us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:07.347319 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:07.347457 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:07.364566 (+ 17109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:07.364571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:07.364602 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:07.364811 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.364822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.366117 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.366121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.367359 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:07.367379 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.368439 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.368443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:07.368552 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.368588 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 18:42:07.368647 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 18:42:07.368732 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13695,"thread_start_us":140,"threads_started":1}
I20260806 18:42:07.370070 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.334233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:32787 (local address 127.12.177.131:46809)
0806 18:42:07.339166 (+ 4933us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:07.339174 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:07.364219 (+ 25045us) server_negotiation.cc:407] Connection header received
0806 18:42:07.364310 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:07.364313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:07.364382 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:07.364968 (+ 586us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:07.365109 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.365945 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.367551 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.368281 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.369676 (+ 1395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.369763 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:07.369820 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 18:42:07.369908 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4855,"thread_start_us":150,"threads_started":1}
I20260806 18:42:07.370850 527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3226e8c843a43b7a6d08c1707d5b0cf" candidate_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48991ceca97449c9b7b574f0e34ee06" is_pre_election: true
I20260806 18:42:07.371170 527 raft_consensus.cc:2379] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff87214d3d6b4c1da06e0d798f6fcfef in current term 1: Already voted for candidate 97e07cca227c4500adadad46967ffc31 in this term.
I20260806 18:42:07.372063 32690 leader_election.cc:302] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff87214d3d6b4c1da06e0d798f6fcfef; no voters: 97e07cca227c4500adadad46967ffc31, e48991ceca97449c9b7b574f0e34ee06
I20260806 18:42:07.372695 656 raft_consensus.cc:2726] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 18:42:07.440604 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.431605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44208 (local address 127.12.177.129:37079)
0806 18:42:07.431738 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:07.431754 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:07.434742 (+ 2988us) server_negotiation.cc:407] Connection header received
0806 18:42:07.435215 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:07.435219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:07.435306 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:07.435409 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:07.435924 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.436724 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.438215 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:07.438570 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:07.438660 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:07.439359 (+ 699us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:07.440020 (+ 661us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:07.440130 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:07.440331 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 18:42:07.440412 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 18:42:07.460332 328 raft_consensus.cc:1261] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 1 FOLLOWER]: Refusing update from remote peer 97e07cca227c4500adadad46967ffc31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:07.461915 665 consensus_queue.cc:1035] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff87214d3d6b4c1da06e0d798f6fcfef" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:07.462910 527 raft_consensus.cc:1261] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 1 FOLLOWER]: Refusing update from remote peer 97e07cca227c4500adadad46967ffc31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:07.464154 654 consensus_queue.cc:1035] T b3226e8c843a43b7a6d08c1707d5b0cf P 97e07cca227c4500adadad46967ffc31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e48991ceca97449c9b7b574f0e34ee06" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 46809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:07.498817 673 mvcc.cc:205] Tried to move back new op lower bound from 7315626915652706304 to 7315626915224739840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626915652706304}]
I20260806 18:42:07.506630 676 mvcc.cc:205] Tried to move back new op lower bound from 7315626915652706304 to 7315626915224739840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626915652706304}]
I20260806 18:42:07.509179 674 mvcc.cc:205] Tried to move back new op lower bound from 7315626915652706304 to 7315626915224739840. Current Snapshot: MvccSnapshot[applied={T|T < 7315626915652706304 or (T in {7315626915652706304})}]
I20260806 18:42:07.521486 32349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:07.521723 32349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:07.525513 32349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d69b52fb8e74b029aa2aa3525876a20: Sending DeleteTablet for 3 replicas of tablet b3226e8c843a43b7a6d08c1707d5b0cf
I20260806 18:42:07.527577 480 tablet_service.cc:1514] Processing DeleteTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:07 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:33934
I20260806 18:42:07.528301 32533 tablet_service.cc:1514] Processing DeleteTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:07 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44200
I20260806 18:42:07.528367 32760 tablet_service.cc:1514] Processing DeleteTablet for tablet b3226e8c843a43b7a6d08c1707d5b0cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:07 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:52950
I20260806 18:42:07.529413 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 32416
I20260806 18:42:07.545020 683 tablet_replica.cc:330] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: stopping tablet replica
I20260806 18:42:07.545578 683 raft_consensus.cc:2229] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:07.546005 683 raft_consensus.cc:2258] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:07.549405 683 ts_tablet_manager.cc:1905] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:07.551337 685 tablet_replica.cc:330] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: stopping tablet replica
I20260806 18:42:07.551848 685 raft_consensus.cc:2229] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:07.552932 685 raft_consensus.cc:2258] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:07.553009 683 ts_tablet_manager.cc:1918] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:07.553144 683 log.cc:1196] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/b3226e8c843a43b7a6d08c1707d5b0cf
I20260806 18:42:07.553580 683 ts_tablet_manager.cc:1939] T b3226e8c843a43b7a6d08c1707d5b0cf P e48991ceca97449c9b7b574f0e34ee06: Deleting consensus metadata
I20260806 18:42:07.555192 32330 catalog_manager.cc:4841] TS e48991ceca97449c9b7b574f0e34ee06 (127.12.177.131:46809): tablet b3226e8c843a43b7a6d08c1707d5b0cf (table test-table [id=fefa2c342a7b405ea56794fb5cb82379]) successfully deleted
I20260806 18:42:07.555687 685 ts_tablet_manager.cc:1905] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:07.559518 685 ts_tablet_manager.cc:1918] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:07.559679 685 log.cc:1196] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/b3226e8c843a43b7a6d08c1707d5b0cf
I20260806 18:42:07.560086 685 ts_tablet_manager.cc:1939] T b3226e8c843a43b7a6d08c1707d5b0cf P ff87214d3d6b4c1da06e0d798f6fcfef: Deleting consensus metadata
I20260806 18:42:07.562443 32329 catalog_manager.cc:4841] TS ff87214d3d6b4c1da06e0d798f6fcfef (127.12.177.130:36639): tablet b3226e8c843a43b7a6d08c1707d5b0cf (table test-table [id=fefa2c342a7b405ea56794fb5cb82379]) successfully deleted
W20260806 18:42:07.568560 32329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:37079 (error 108)
I20260806 18:42:07.570828 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 32657
I20260806 18:42:07.587396 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:07.570243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:37079 (local address 127.0.0.1:44224)
0806 18:42:07.587091 (+ 16848us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:07.587249 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16628,"thread_start_us":71,"threads_started":1}
W20260806 18:42:07.587651 32329 catalog_manager.cc:4584] TS 97e07cca227c4500adadad46967ffc31 (127.12.177.129:37079): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3226e8c843a43b7a6d08c1707d5b0cf: Network error: Client connection negotiation failed: client connection to 127.12.177.129:37079: connect: Connection refused (error 111)
I20260806 18:42:07.604897 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 396
I20260806 18:42:07.624145 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 32303
I20260806 18:42:07.644259 12998 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 18:42:08.001109 12998 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 18:42:08.001264 12998 mini_ranger.cc:66] Stopping Ranger...
I20260806 18:42:08.368366 12998 mini_ranger.cc:68] Stopped Ranger
2026-08-06 18:42:08.368 UTC [30879] LOG: received smart shutdown request
2026-08-06 18:42:08.373 UTC [30879] LOG: background worker "logical replication launcher" (PID 30900) exited with exit code 1
2026-08-06 18:42:08.374 UTC [30888] LOG: shutting down
2026-08-06 18:42:08.616 UTC [30879] LOG: database system is shut down
2026-08-06T18:42:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (59037 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:42:08 dist-test-slave-j2vl krb5kdc[701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:42:08 dist-test-slave-j2vl krb5kdc[701](info): set up 2 sockets
Aug 06 18:42:08 dist-test-slave-j2vl krb5kdc[701](info): commencing operation
krb5kdc: starting...
W20260806 18:42:10.074651 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:42:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:42:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:42:10.229548 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34959
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:10.355610 723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:10.355986 723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:10.356072 723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:10.360424 723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:10.360541 723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:10.360579 723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:10.360620 723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:10.360659 723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:10.366698 723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:10.368078 723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:10.369242 723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:10.379237 732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.379179 731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.379199 737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:10.379812 723 server_base.cc:1034] running on GCE node
I20260806 18:42:10.380569 723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:10.381922 723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:10.383121 723 hybrid_clock.cc:648] HybridClock initialized: now 1786041730383108 us; error 30 us; skew 500 ppm
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:10.386653 723 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:10.387784 723 webserver.cc:460] Webserver started at http://127.12.177.190:36811/ using document root <none> and password file <none>
I20260806 18:42:10.388454 723 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:10.388559 723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:10.388824 723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:10.391829 723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "f8f87e8799bac30cf5565b544ddddba0"
server_key_iv: "d56ff1c496fa433ac7575208ae82acf0"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.392613 723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "f8f87e8799bac30cf5565b544ddddba0"
server_key_iv: "d56ff1c496fa433ac7575208ae82acf0"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.397058 723 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260806 18:42:10.400053 753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:10.402096 723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:10.402294 723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "f8f87e8799bac30cf5565b544ddddba0"
server_key_iv: "d56ff1c496fa433ac7575208ae82acf0"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.402447 723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:10.422698 723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:10.426131 723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:10.426371 723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:10.434443 723 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:34959
I20260806 18:42:10.434823 836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:34959 every 8 connection(s)
I20260806 18:42:10.435612 723 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:10.438832 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 723
I20260806 18:42:10.438982 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:42:10.439091 838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:10.439299 12998 external_mini_cluster.cc:1428] Setting key d2d254adb390e926df7c717e67f7f18a
I20260806 18:42:10.445031 838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.177.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.189@KRBTEST.COM" created.
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:10.464658 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.448103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.12.177.190:34959)
0806 18:42:10.448847 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.448868 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.449096 (+ 228us) server_negotiation.cc:407] Connection header received
0806 18:42:10.450508 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.450513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.450726 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.450940 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.451894 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.452986 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.454254 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.454959 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.455172 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.458358 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.458364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.458377 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.458400 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.460426 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.461015 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.461022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.461024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.461147 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.461692 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.461696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.461698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.462367 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.462548 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.463128 (+ 580us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.463418 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"spinlock_wait_cycles":95488,"thread_start_us":208,"threads_started":1}
I20260806 18:42:10.464694 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.448103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34959 (local address 127.0.0.1:37388)
0806 18:42:10.448880 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.448945 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.450063 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.451005 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.451010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.451374 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.451697 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.451714 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.453140 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.453145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.454110 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.454121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.455200 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.455208 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.455386 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.456078 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.456105 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.458155 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.460585 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.460595 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.460607 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.460861 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.461314 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.461318 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.461320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.461521 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.462545 (+ 1024us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:10.462556 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:10.462779 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 18:42:10.462996 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 18:42:10.463519 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"mutex_wait_us":85,"thread_start_us":208,"threads_started":1}
I20260806 18:42:10.475095 838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:42:10.477949 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.476897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51964)
0806 18:42:10.477676 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.477819 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":648}
W20260806 18:42:10.478753 755 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
I20260806 18:42:10.481158 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.480524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51978)
0806 18:42:10.480662 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.480728 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 18:42:10.481755 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:33223: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
I20260806 18:42:10.485313 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:33223
--webserver_interface=127.12.177.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:10.531533 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } attempt: 1
I20260806 18:42:10.532598 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.532225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51980)
0806 18:42:10.532416 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.532498 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 18:42:10.533469 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.533193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51982)
0806 18:42:10.533317 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.533400 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 18:42:10.533655 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:33223: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
I20260806 18:42:10.601853 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } attempt: 2
I20260806 18:42:10.602901 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.602560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51992)
0806 18:42:10.602742 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.602811 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 18:42:10.603902 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.603596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:51996)
0806 18:42:10.603743 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.603804 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260806 18:42:10.604067 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:33223: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
W20260806 18:42:10.616966 850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:10.617357 850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:10.617494 850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:10.621925 850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:10.622037 850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:10.622076 850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:10.622136 850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:10.622193 850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:10.628793 850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:33223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.177.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:10.630156 850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:10.631332 850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:10.641777 861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.641776 864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.641776 862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:10.642467 850 server_base.cc:1034] running on GCE node
I20260806 18:42:10.643333 850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:10.644788 850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:10.646114 850 hybrid_clock.cc:648] HybridClock initialized: now 1786041730646071 us; error 61 us; skew 500 ppm
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:10.649592 850 init.cc:377] Logged in from keytab as kudu/127.12.177.189@KRBTEST.COM (short username kudu)
I20260806 18:42:10.650869 850 webserver.cc:460] Webserver started at http://127.12.177.189:37279/ using document root <none> and password file <none>
I20260806 18:42:10.651556 850 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:10.651667 850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:10.651971 850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:10.654549 850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data/instance:
uuid: "66b5b8a8ba5c440189935b25012be5e9"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "a6e947a8282fc6fd4fce3d9ea5098d50"
server_key_iv: "e4c23867563304287993fe38b743c5c3"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.655267 850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal/instance:
uuid: "66b5b8a8ba5c440189935b25012be5e9"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "a6e947a8282fc6fd4fce3d9ea5098d50"
server_key_iv: "e4c23867563304287993fe38b743c5c3"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.659808 850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:42:10.663066 873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:10.664901 850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:42:10.665092 850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "66b5b8a8ba5c440189935b25012be5e9"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "a6e947a8282fc6fd4fce3d9ea5098d50"
server_key_iv: "e4c23867563304287993fe38b743c5c3"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.665246 850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:10.682822 850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:10.688040 850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:10.688336 850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:10.695245 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } attempt: 3
I20260806 18:42:10.696204 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.695838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:52012)
0806 18:42:10.696024 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.696107 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:33223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 18:42:10.696810 850 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.189:33223
I20260806 18:42:10.697109 955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.189:33223 every 8 connection(s)
I20260806 18:42:10.698021 850 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
I20260806 18:42:10.700827 959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:10.705581 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 850
I20260806 18:42:10.705220 959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:42:10.705724 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-1/wal/instance
I20260806 18:42:10.706071 12998 external_mini_cluster.cc:1428] Setting key 8cc36d820205ecd765e417b48f23a77a
I20260806 18:42:10.711854 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.696851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:52022)
0806 18:42:10.697038 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.697050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.697130 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.699968 (+ 2838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.699971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.700189 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.700338 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.700347 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.701827 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.701832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.702385 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.702395 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.703779 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.703784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.703905 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.704485 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.704499 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.706116 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.709590 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.709597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.709600 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.709925 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.710396 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.710402 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.710407 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.710516 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.711305 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:10.711308 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:10.711419 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 18:42:10.711531 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 18:42:10.711681 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260806 18:42:10.713101 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.698016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.12.177.189:33223)
0806 18:42:10.698498 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.698518 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.698589 (+ 71us) server_negotiation.cc:407] Connection header received
0806 18:42:10.699321 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.699339 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.699678 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.700038 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.700519 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.701691 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.702521 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.703606 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.703808 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.706379 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.706387 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.706406 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.706446 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.709448 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.710063 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.710072 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.710079 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.710267 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.710624 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.710627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.710629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.711183 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.711325 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.711688 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.712087 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":337,"thread_start_us":155,"threads_started":1}
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:10.715761 838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:42:10.716689 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.716370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58032)
0806 18:42:10.716532 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.716594 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
WARNING: no policy specified for kudu/127.12.177.188@KRBTEST.COM; defaulting to no policy
I20260806 18:42:10.717871 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.717159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58040)
0806 18:42:10.717665 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.717735 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":158,"threads_started":1}
W20260806 18:42:10.718133 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.720415 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.707770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.12.177.190:34959)
0806 18:42:10.707991 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.707997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.708485 (+ 488us) server_negotiation.cc:407] Connection header received
0806 18:42:10.708726 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.708732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.708799 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.708904 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.709763 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.710919 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.712621 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.712982 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.713100 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.716049 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.716052 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.716054 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.716077 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.717928 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.718608 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.718616 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.718617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.718740 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.719167 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.719170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.719171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.719524 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.719682 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.720094 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.720238 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:42:10.720585 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.707650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34959 (local address 127.0.0.1:37394)
0806 18:42:10.708334 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.708396 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.708596 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.708968 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.708975 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.709449 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.709641 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.709648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.711071 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.711078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.712484 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.712497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.713133 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.713141 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.713328 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.714003 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.714024 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.715831 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.718054 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.718066 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.718074 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.718445 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.718889 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.718893 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.718895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.719007 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.719683 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:10.719693 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:10.719851 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 18:42:10.720032 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 18:42:10.720358 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":212,"thread_start_us":189,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.188@KRBTEST.COM" created.
I20260806 18:42:10.722209 959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:42:10.731600 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.722835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:52026)
0806 18:42:10.722958 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.722972 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.723059 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.723313 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.723316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.723505 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.723600 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.723606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.724323 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.724328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.724844 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.724851 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.725300 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.725303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.725485 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.725999 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.726010 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.727249 (+ 1239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.729943 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.729949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.729951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.730155 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.730455 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.730459 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.730461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.730543 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.730981 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:10.730984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:10.731082 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 18:42:10.731192 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 18:42:10.731391 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":68}
I20260806 18:42:10.731600 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.722883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52026 (local address 127.12.177.189:33223)
0806 18:42:10.723158 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.723161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.723169 (+ 8us) server_negotiation.cc:407] Connection header received
0806 18:42:10.723189 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.723191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.723218 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.723297 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.723714 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.724218 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.724964 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.725182 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.725287 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.727391 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.727397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.727404 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.727425 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.729789 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.730269 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.730273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.730274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.730361 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.730670 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.730675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.730677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.730882 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.730994 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.731239 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.731453 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":228}
I20260806 18:42:10.732846 959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:42:10.733821 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.733498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58050)
0806 18:42:10.733630 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.733727 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 18:42:10.734743 877 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.735913 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.735643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58054)
0806 18:42:10.735765 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.735841 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 18:42:10.736168 959 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
I20260806 18:42:10.741677 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:45179
--webserver_interface=127.12.177.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:10.749384 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 1
I20260806 18:42:10.750463 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.750030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58066)
0806 18:42:10.750240 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.750328 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 18:42:10.751354 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.751051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58074)
0806 18:42:10.751198 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.751266 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 18:42:10.751543 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.785501 959 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 1
I20260806 18:42:10.786515 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.786177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58076)
0806 18:42:10.786366 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.786432 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 18:42:10.787405 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.787120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58092)
0806 18:42:10.787294 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.787342 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 18:42:10.787552 959 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.826768 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 2
I20260806 18:42:10.827754 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.827392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58094)
0806 18:42:10.827575 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.827653 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 18:42:10.828624 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.828354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58104)
0806 18:42:10.828488 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.828550 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 18:42:10.828778 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.855770 959 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 2
I20260806 18:42:10.856729 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.856413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58116)
0806 18:42:10.856574 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.856647 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 18:42:10.857570 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.857306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58130)
0806 18:42:10.857445 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.857509 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 18:42:10.857733 959 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
W20260806 18:42:10.874161 971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:10.874533 971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:10.874616 971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:10.879128 971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:10.879248 971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:10.879287 971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:10.879333 971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:10.879366 971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:10.885294 971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34959,127.12.177.189:33223,127.12.177.188:45179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:45179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.177.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:10.886683 971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:10.887831 971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:10.898938 978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.898891 984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:10.899142 979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:10.899458 971 server_base.cc:1034] running on GCE node
I20260806 18:42:10.900228 971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:10.902055 971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:10.905857 971 hybrid_clock.cc:648] HybridClock initialized: now 1786041730905549 us; error 280 us; skew 500 ppm
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:10.910154 971 init.cc:377] Logged in from keytab as kudu/127.12.177.188@KRBTEST.COM (short username kudu)
I20260806 18:42:10.911401 971 webserver.cc:460] Webserver started at http://127.12.177.188:34827/ using document root <none> and password file <none>
I20260806 18:42:10.912025 971 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:10.912102 971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:10.912314 971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:10.914860 971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data/instance:
uuid: "96b3ecb7818345e79fcd469b9df30de6"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "c4889980ea840a3518a4f2a151ea9a23"
server_key_iv: "243683f8f4b7a4b3c68d1f0ebcb45d4e"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.916028 971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal/instance:
uuid: "96b3ecb7818345e79fcd469b9df30de6"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "c4889980ea840a3518a4f2a151ea9a23"
server_key_iv: "243683f8f4b7a4b3c68d1f0ebcb45d4e"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.921698 971 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 18:42:10.924759 993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:10.926697 971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:10.926873 971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "96b3ecb7818345e79fcd469b9df30de6"
format_stamp: "Formatted at 2026-08-06 18:42:10 on dist-test-slave-j2vl"
server_key: "c4889980ea840a3518a4f2a151ea9a23"
server_key_iv: "243683f8f4b7a4b3c68d1f0ebcb45d4e"
server_key_version: "encryptionkey@0"
I20260806 18:42:10.927115 971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:10.927986 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 3
I20260806 18:42:10.929075 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.928738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58140)
0806 18:42:10.928925 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.928992 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 18:42:10.929952 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.929680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58146)
0806 18:42:10.929836 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.929889 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 18:42:10.930095 838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.948945 959 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 3
I20260806 18:42:10.950007 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.949653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58152)
0806 18:42:10.949843 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.949915 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 18:42:10.950904 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.950606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58166)
0806 18:42:10.950794 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.950842 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 18:42:10.951040 959 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:45179: Network error: Client connection negotiation failed: client connection to 127.12.177.188:45179: connect: Connection refused (error 111)
I20260806 18:42:10.953652 971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:10.957428 971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:10.957655 971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:10.965842 971 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.188:45179
I20260806 18:42:10.965969 1069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.188:45179 every 8 connection(s)
I20260806 18:42:10.967129 971 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
I20260806 18:42:10.970661 1071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:10.971284 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 971
I20260806 18:42:10.971441 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786041540454168-12998-0/minicluster-data/master-2/wal/instance
I20260806 18:42:10.971728 12998 external_mini_cluster.cc:1428] Setting key eea2b3aac0ae201f328ed88b7bc0b009
I20260806 18:42:10.976419 1071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:10.988745 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.973240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58182 (local address 127.12.177.188:45179)
0806 18:42:10.973804 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.973821 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.973860 (+ 39us) server_negotiation.cc:407] Connection header received
0806 18:42:10.974583 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.974602 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.974986 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.975308 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.976408 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.977628 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.978759 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.979473 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.979669 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.982443 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.982450 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.982462 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.982497 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.984560 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.985164 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.985179 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.985185 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.985334 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.985736 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.985740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.985742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.986502 (+ 760us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.986745 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.987099 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.987497 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":159,"threads_started":1}
I20260806 18:42:10.989068 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.978617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37410 (local address 127.12.177.190:34959)
0806 18:42:10.978819 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.978825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.979173 (+ 348us) server_negotiation.cc:407] Connection header received
0806 18:42:10.979361 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.979369 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.979417 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.979507 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.980253 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.980766 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.981811 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.982168 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.982290 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.984897 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.984901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.984903 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.984943 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.986940 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.987518 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.987521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.987523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.987623 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.988035 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.988039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.988041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.988277 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:10.988384 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:10.988759 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 18:42:10.988905 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:42:10.989133 1080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.978554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34959 (local address 127.0.0.1:37410)
0806 18:42:10.979042 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.979088 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.979245 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.979568 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.979575 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.979976 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.980121 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.980127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.980907 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.980917 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.981675 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.981687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.982359 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.982364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.982478 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.983071 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.983083 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.984722 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.987081 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.987092 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.987098 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.987411 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.987742 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.987744 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.987746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.987864 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.988409 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:10.988415 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:10.988540 (+ 125us) client_negotiation.cc:769] Sending connection context
0806 18:42:10.988672 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 18:42:10.988935 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":179,"threads_started":1}
I20260806 18:42:10.990693 1071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
Aug 06 18:42:10 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:11.000826 1080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.991328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:33223 (local address 127.0.0.1:52028)
0806 18:42:10.991440 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:10.991457 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:10.991543 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:10.991841 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:10.991844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:10.992110 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:10.992262 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.992269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.993123 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.993126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.993918 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:10.993930 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.994420 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.994424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:10.994539 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.995463 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:10.995480 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:10.996857 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:10.999044 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.999048 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.999050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.999276 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:10.999618 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:10.999621 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:10.999625 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:10.999716 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.000164 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:11.000167 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:11.000304 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 18:42:11.000442 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 18:42:11.000622 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 18:42:11.001238 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.991484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52028 (local address 127.12.177.189:33223)
0806 18:42:10.991626 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.991631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.991645 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:42:10.991691 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.991693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.991733 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.991823 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.992418 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.992985 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.994063 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.994294 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.994383 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.997102 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.997112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.997115 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.997144 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:10.998804 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.999415 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.999419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.999420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:10.999512 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:10.999829 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:10.999833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:10.999835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.000054 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.000172 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.000949 (+ 777us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.001107 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 18:42:11.002552 1071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:42:11.002734 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:10.991739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37412 (local address 127.12.177.190:34959)
0806 18:42:10.991876 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:10.991879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:10.992097 (+ 218us) server_negotiation.cc:407] Connection header received
0806 18:42:10.992214 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:10.992216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:10.992255 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:10.992336 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:10.992998 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.993625 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.994595 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:10.994911 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:10.995192 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:10.998235 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:10.998241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:10.998245 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:10.998281 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.000196 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.000878 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.000882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.000883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.000985 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.001632 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.001636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.001637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.001940 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.002337 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.002427 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.002581 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 18:42:11 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:42:11 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:42:11.013897 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.003273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58190 (local address 127.12.177.188:45179)
0806 18:42:11.003414 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.003417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.003527 (+ 110us) server_negotiation.cc:407] Connection header received
0806 18:42:11.003620 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.003623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.003678 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.003803 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.004315 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.005692 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.006664 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.006964 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.007091 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.009657 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.009663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.009668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.009704 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.011655 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.012189 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.012194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.012197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.012327 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.012722 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.012727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.012729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.013019 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.013107 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.013594 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.013733 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":61}
I20260806 18:42:11.013897 1080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.003273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58190)
0806 18:42:11.003467 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:11.003479 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:11.003556 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:11.003833 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:11.003836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:11.004037 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:11.004158 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.004165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.005824 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.005828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.006541 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.006552 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.007109 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.007113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.007207 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.007846 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:11.007859 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:11.009485 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:11.011778 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.011784 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.011789 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.012066 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.012456 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.012459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.012461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.012568 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.013158 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:11.013163 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:11.013310 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 18:42:11.013488 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 18:42:11.013662 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260806 18:42:11.016302 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.004516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52040 (local address 127.12.177.189:33223)
0806 18:42:11.004643 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.004649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.004664 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:42:11.004814 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.004817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.004880 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.004966 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.006043 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.006586 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.007731 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.007991 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.008079 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.011630 (+ 3551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.011634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.011636 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.011667 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.013938 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.014772 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.014776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.014778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.014880 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.015204 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.015209 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.015211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.015425 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.015690 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.015859 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.016101 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:42:11.017918 1071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: Bootstrap starting.
I20260806 18:42:11.020385 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:42:11.020787 1071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:11.021761 1071 log.cc:824] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:11.025171 1071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: No bootstrap required, opened a new log
I20260806 18:42:11.031351 1071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.031685 1071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:11.031750 1071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96b3ecb7818345e79fcd469b9df30de6, State: Initialized, Role: FOLLOWER
I20260806 18:42:11.032958 1071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.033635 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.023143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52052 (local address 127.12.177.189:33223)
0806 18:42:11.023266 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.023270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.023567 (+ 297us) server_negotiation.cc:407] Connection header received
0806 18:42:11.023658 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.023662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.023715 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.023803 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.024672 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.025536 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.026769 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.027096 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.027175 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.028969 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.028973 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.028976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.029013 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.030779 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.031925 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.031929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.031931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.032033 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.032432 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.032438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.032439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.032708 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.032830 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.033253 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.033452 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:42:11.034693 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.022723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37428 (local address 127.12.177.190:34959)
0806 18:42:11.022861 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.022866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.023051 (+ 185us) server_negotiation.cc:407] Connection header received
0806 18:42:11.023260 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.023265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.023319 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.023386 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.024380 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.025154 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.026406 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.026742 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.026851 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.028942 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.028946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.028949 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.028987 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.032365 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.033010 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.033013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.033015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.033124 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.033476 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.033480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.033481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.033710 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.033852 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.034407 (+ 555us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.034547 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:42:11.034942 1071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:11.035687 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.023165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58200 (local address 127.12.177.188:45179)
0806 18:42:11.023285 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.023291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.024581 (+ 1290us) server_negotiation.cc:407] Connection header received
0806 18:42:11.024753 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.024756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.024803 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.024852 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.025877 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.026686 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.027773 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.028135 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.028243 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.030302 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.030306 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.030309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.030352 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.032191 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.033072 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.033076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.033078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.033172 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.034105 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.034108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.034110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.034362 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.034483 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.035406 (+ 923us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.035536 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 18:42:11.037573 1093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.037858 1093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 18:42:11.041157 1107 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:42:11.041265 1107 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:42:11.038990 971 master_runner.cc:186] Error getting master registration for 127.12.177.190:34959: OK, instance_id { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" instance_seqno: 1786041730432115 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 18:42:11.042429 971 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:42:11.094283 959 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 4
I20260806 18:42:11.094283 838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } attempt: 4
Aug 06 18:42:11 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:42:11 dist-test-slave-j2vl krb5kdc[701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041730, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
I20260806 18:42:11.107427 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.094844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58202)
0806 18:42:11.095049 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:11.095067 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:11.095287 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:11.096149 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:11.096153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:11.096375 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:11.096494 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.096501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.097431 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.097434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.098064 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.098074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.098606 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.098610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.098728 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.099358 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:11.099375 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:11.101228 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:11.105292 (+ 4064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.105296 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.105299 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.105759 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.106123 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.106127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.106129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.106223 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.106813 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:11.106817 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:11.106935 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 18:42:11.107023 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 18:42:11.107204 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260806 18:42:11.108115 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.094877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:45179 (local address 127.0.0.1:58204)
0806 18:42:11.095049 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:11.095067 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:11.095171 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:11.095510 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:11.095517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:11.095754 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:11.095897 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.095905 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.097421 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.097425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.098590 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:11.098606 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.099185 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.099189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:11.099309 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.099795 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:11.099811 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:11.101775 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:11.105861 (+ 4086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.105864 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.105866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.106179 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.106529 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:11.106532 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:11.106534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:11.106644 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:11.107553 (+ 909us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:11.107558 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:11.107704 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 18:42:11.107812 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 18:42:11.107973 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 18:42:11.108152 1112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.095351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.12.177.188:45179)
0806 18:42:11.095847 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.095858 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.095875 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:42:11.095914 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.095917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.095964 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.096122 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.096639 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.097275 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.098223 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.098472 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.098589 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.101438 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.101446 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.101449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.101495 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.105125 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.105913 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.105917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.105919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.106016 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.106354 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.106357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.106359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.106692 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.107696 (+ 1004us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.107787 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.107933 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":190,"threads_started":1}
I20260806 18:42:11.108855 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:11.095023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58204 (local address 127.12.177.188:45179)
0806 18:42:11.095187 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:11.095193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:11.095212 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:42:11.095297 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:11.095301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:11.095355 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:11.095453 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:11.096045 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.096868 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.098739 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:11.099057 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:11.099171 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:11.101956 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:11.101963 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:11.101967 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:11.102003 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:11.105646 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.106340 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.106342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.106344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.106419 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:11.106760 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:11.106764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:11.106766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:11.107016 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:11.108470 (+ 1454us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:11.108549 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 18:42:11.108685 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 18:42:11.111950 838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: Bootstrap starting.
I20260806 18:42:11.111950 959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: Bootstrap starting.
I20260806 18:42:11.115317 838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:11.115317 959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:11.116413 959 log.cc:824] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:11.116413 838 log.cc:824] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:11.119191 838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: No bootstrap required, opened a new log
I20260806 18:42:11.120395 959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: No bootstrap required, opened a new log
I20260806 18:42:11.123800 838 raft_consensus.cc:348] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.124106 838 raft_consensus.cc:374] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:11.124171 838 raft_consensus.cc:729] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37bfc5ed7d54b8eb0993a9ec04ef530, State: Initialized, Role: FOLLOWER
I20260806 18:42:11.124712 838 consensus_queue.cc:260] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.124804 959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.125025 959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:11.125095 959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b5b8a8ba5c440189935b25012be5e9, State: Initialized, Role: FOLLOWER
I20260806 18:42:11.125586 959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.126186 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.126416 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:42:11.126423 838 sys_catalog.cc:564] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:11.126910 959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:11.129823 1116 sys_catalog.cc:455] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.129997 1116 sys_catalog.cc:458] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 18:42:11.137456 1168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 18:42:11.137598 850 master_runner.cc:263] No leader master found from master 66b5b8a8ba5c440189935b25012be5e9
W20260806 18:42:11.138115 1166 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 18:42:11.138166 723 master_runner.cc:263] No leader master found from master d37bfc5ed7d54b8eb0993a9ec04ef530
W20260806 18:42:11.137653 1168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:42:11.138274 723 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 18:42:11.138211 1166 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:42:11.137692 850 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 18:42:11.178432 763 tablet.cc:2369] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:11.190442 880 tablet.cc:2369] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:11.209379 999 tablet.cc:2369] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:42:11.272725 1116 raft_consensus.cc:482] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:11.272969 1116 raft_consensus.cc:504] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.274163 1116 leader_election.cc:288] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66b5b8a8ba5c440189935b25012be5e9 (127.12.177.189:33223), 96b3ecb7818345e79fcd469b9df30de6 (127.12.177.188:45179)
I20260806 18:42:11.274843 908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b5b8a8ba5c440189935b25012be5e9" is_pre_election: true
I20260806 18:42:11.274955 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96b3ecb7818345e79fcd469b9df30de6" is_pre_election: true
I20260806 18:42:11.275190 908 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d37bfc5ed7d54b8eb0993a9ec04ef530 in term 0.
I20260806 18:42:11.275279 1030 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d37bfc5ed7d54b8eb0993a9ec04ef530 in term 0.
I20260806 18:42:11.275765 758 leader_election.cc:302] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96b3ecb7818345e79fcd469b9df30de6, d37bfc5ed7d54b8eb0993a9ec04ef530; no voters:
I20260806 18:42:11.276335 1116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:11.276445 1116 raft_consensus.cc:482] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:11.276491 1116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:11.277992 1116 raft_consensus.cc:504] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.278867 908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b5b8a8ba5c440189935b25012be5e9"
I20260806 18:42:11.278868 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96b3ecb7818345e79fcd469b9df30de6"
I20260806 18:42:11.279009 908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:11.279017 1030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:11.280617 908 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37bfc5ed7d54b8eb0993a9ec04ef530 in term 1.
I20260806 18:42:11.280555 1030 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37bfc5ed7d54b8eb0993a9ec04ef530 in term 1.
I20260806 18:42:11.281203 758 leader_election.cc:302] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 66b5b8a8ba5c440189935b25012be5e9, 96b3ecb7818345e79fcd469b9df30de6, d37bfc5ed7d54b8eb0993a9ec04ef530; no voters:
I20260806 18:42:11.281672 1116 leader_election.cc:288] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [CANDIDATE]: Term 1 election: Requested vote from peers 66b5b8a8ba5c440189935b25012be5e9 (127.12.177.189:33223), 96b3ecb7818345e79fcd469b9df30de6 (127.12.177.188:45179)
I20260806 18:42:11.281864 1116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:11.281963 1116 raft_consensus.cc:686] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [term 1 LEADER]: Becoming Leader. State: Replica: d37bfc5ed7d54b8eb0993a9ec04ef530, State: Running, Role: LEADER
I20260806 18:42:11.282358 1116 consensus_queue.cc:237] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } }
I20260806 18:42:11.284323 1116 sys_catalog.cc:455] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d37bfc5ed7d54b8eb0993a9ec04ef530. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.284484 1116 sys_catalog.cc:458] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:11.284920 1176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:11.286054 1176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:11.293090 1030 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [term 1 FOLLOWER]: Refusing update from remote peer d37bfc5ed7d54b8eb0993a9ec04ef530: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:11.293160 908 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [term 1 FOLLOWER]: Refusing update from remote peer d37bfc5ed7d54b8eb0993a9ec04ef530: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:11.294003 1172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:11.294457 1116 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:11.298789 1093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d37bfc5ed7d54b8eb0993a9ec04ef530. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.298980 1093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:42:11.299652 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d37bfc5ed7d54b8eb0993a9ec04ef530. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.300370 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:42:11.304163 1172 sys_catalog.cc:455] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.304360 1172 sys_catalog.cc:458] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:11.305068 1093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.305203 1093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:42:11.305320 1116 sys_catalog.cc:455] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.305483 1116 sys_catalog.cc:458] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:11.305954 1182 mvcc.cc:205] Tried to move back new op lower bound from 7315626931364651008 to 7315626931335708672. Current Snapshot: MvccSnapshot[applied={T|T < 7315626931364651008}]
I20260806 18:42:11.306649 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d37bfc5ed7d54b8eb0993a9ec04ef530" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34959 } } peers { permanent_uuid: "66b5b8a8ba5c440189935b25012be5e9" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 33223 } } peers { permanent_uuid: "96b3ecb7818345e79fcd469b9df30de6" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 45179 } } }
I20260806 18:42:11.306818 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:42:11.308832 1180 mvcc.cc:205] Tried to move back new op lower bound from 7315626931364651008 to 7315626931335708672. Current Snapshot: MvccSnapshot[applied={T|T < 7315626931364651008}]
I20260806 18:42:11.310907 1176 catalog_manager.cc:1347] Generated new cluster ID: 45bff3d405964793b416afdeb93d65c0
I20260806 18:42:11.311007 1176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:11.329169 1176 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:42:11.330615 1176 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:11.355957 1176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d37bfc5ed7d54b8eb0993a9ec04ef530: Generated new TSK 0
I20260806 18:42:11.356801 1176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:42:12.042830 1107 catalog_manager.cc:1259] Loaded cluster ID: 45bff3d405964793b416afdeb93d65c0
I20260806 18:42:12.042927 1107 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: loading cluster ID for follower catalog manager: success
I20260806 18:42:12.044725 1107 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: acquiring CA information for follower catalog manager: success
I20260806 18:42:12.046126 1107 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 96b3ecb7818345e79fcd469b9df30de6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:42:12.139655 1168 catalog_manager.cc:1259] Loaded cluster ID: 45bff3d405964793b416afdeb93d65c0
I20260806 18:42:12.139748 1168 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: loading cluster ID for follower catalog manager: success
I20260806 18:42:12.141557 1168 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: acquiring CA information for follower catalog manager: success
I20260806 18:42:12.142817 1168 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 66b5b8a8ba5c440189935b25012be5e9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:42:12.429493 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 723
I20260806 18:42:12.446985 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 850
I20260806 18:42:12.461876 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 971
2026-08-06T18:42:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3705 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:42:12 dist-test-slave-j2vl krb5kdc[1200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:42:12 dist-test-slave-j2vl krb5kdc[1200](info): set up 2 sockets
Aug 06 18:42:12 dist-test-slave-j2vl krb5kdc[1200](info): commencing operation
krb5kdc: starting...
W20260806 18:42:13.750828 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:42:13 dist-test-slave-j2vl krb5kdc[1200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:42:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:42:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:42:13.897846 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37695
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:42657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:14.018146 1221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:14.018520 1221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:14.018596 1221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:14.022924 1221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:14.023047 1221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:14.023085 1221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:14.023128 1221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:14.023166 1221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:14.029199 1221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:42657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:14.030514 1221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:14.031639 1221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:14.041308 1227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:14.041292 1231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:14.041649 1221 server_base.cc:1034] running on GCE node
W20260806 18:42:14.041299 1229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:14.042483 1221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:14.043807 1221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:14.045049 1221 hybrid_clock.cc:648] HybridClock initialized: now 1786041734045016 us; error 49 us; skew 500 ppm
Aug 06 18:42:14 dist-test-slave-j2vl krb5kdc[1200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041734, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:14.054265 1221 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:14.055538 1221 webserver.cc:460] Webserver started at http://127.12.177.190:41085/ using document root <none> and password file <none>
I20260806 18:42:14.056205 1221 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:14.056281 1221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:14.056547 1221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:14.059262 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "1f8ccbc32905477f97ef58452ca568b2"
format_stamp: "Formatted at 2026-08-06 18:42:14 on dist-test-slave-j2vl"
server_key: "e1735bfa13e682e2765f7095ef84eba6"
server_key_iv: "c143d83358dfb035d375424e62d00273"
server_key_version: "encryptionkey@0"
I20260806 18:42:14.060155 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "1f8ccbc32905477f97ef58452ca568b2"
format_stamp: "Formatted at 2026-08-06 18:42:14 on dist-test-slave-j2vl"
server_key: "e1735bfa13e682e2765f7095ef84eba6"
server_key_iv: "c143d83358dfb035d375424e62d00273"
server_key_version: "encryptionkey@0"
I20260806 18:42:14.065771 1221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 18:42:14.068948 1244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:14.070482 1221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:14.070663 1221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "1f8ccbc32905477f97ef58452ca568b2"
format_stamp: "Formatted at 2026-08-06 18:42:14 on dist-test-slave-j2vl"
server_key: "e1735bfa13e682e2765f7095ef84eba6"
server_key_iv: "c143d83358dfb035d375424e62d00273"
server_key_version: "encryptionkey@0"
I20260806 18:42:14.070807 1221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:14.089964 1221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:14.093700 1221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:14.093930 1221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:14.101708 1221 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:37695
I20260806 18:42:14.101730 1329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:37695 every 8 connection(s)
I20260806 18:42:14.102802 1221 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:14.106060 1330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:14.106941 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 1221
I20260806 18:42:14.107050 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:42:14.107471 12998 external_mini_cluster.cc:1428] Setting key cb5971d039cca8c85c755abfc5aec18c
I20260806 18:42:14.112957 1330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2: Bootstrap starting.
I20260806 18:42:14.116221 1330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:14.117300 1330 log.cc:824] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:42:14 dist-test-slave-j2vl krb5kdc[1200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:14.120513 1330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2: No bootstrap required, opened a new log
I20260806 18:42:14.125554 1333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:14.109093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.12.177.190:37695)
0806 18:42:14.109628 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:14.109645 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:14.109685 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:42:14.110393 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:14.110412 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:14.110774 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:14.111151 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:14.112027 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:14.113068 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:14.114319 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:14.114849 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:14.115013 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:14.118751 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:14.118759 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:14.118783 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:14.118821 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:14.121208 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:14.121851 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:14.121858 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:14.121865 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:14.122035 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:14.122413 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:14.122417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:14.122419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:14.123056 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:14.123317 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:14.123834 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 18:42:14.124223 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":187,"threads_started":1}
I20260806 18:42:14.126171 1330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } }
I20260806 18:42:14.126471 1330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:14.126580 1330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8ccbc32905477f97ef58452ca568b2, State: Initialized, Role: FOLLOWER
I20260806 18:42:14.127146 1330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } }
I20260806 18:42:14.127327 1330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:14.127434 1330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:14.127550 1330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:14.128984 1330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } }
I20260806 18:42:14.129135 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:42:14.129485 1330 leader_election.cc:302] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f8ccbc32905477f97ef58452ca568b2; no voters:
I20260806 18:42:14.129879 1330 leader_election.cc:288] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:42:14.130013 1337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:14.130249 1337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [term 1 LEADER]: Becoming Leader. State: Replica: 1f8ccbc32905477f97ef58452ca568b2, State: Running, Role: LEADER
I20260806 18:42:14.130656 1337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } }
I20260806 18:42:14.131397 1330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:14.132582 1339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f8ccbc32905477f97ef58452ca568b2. Latest consensus state: current_term: 1 leader_uuid: "1f8ccbc32905477f97ef58452ca568b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } } }
I20260806 18:42:14.132737 1339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:14.133162 1349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:14.133212 1338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f8ccbc32905477f97ef58452ca568b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8ccbc32905477f97ef58452ca568b2" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37695 } } }
I20260806 18:42:14.133502 1338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2 [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:14.136097 1349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:14.141896 1349 catalog_manager.cc:1347] Generated new cluster ID: 4557522f870c4a04af6f5fccb5b314c8
I20260806 18:42:14.142009 1349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:14.160302 1349 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:42:14.161542 1349 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:14.172458 1349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f8ccbc32905477f97ef58452ca568b2: Generated new TSK 0
I20260806 18:42:14.173609 1349 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:42:14.186448 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 1221
2026-08-06T18:42:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1730 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:42:14 dist-test-slave-j2vl krb5kdc[1370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:42:14 dist-test-slave-j2vl krb5kdc[1370](info): set up 2 sockets
Aug 06 18:42:14 dist-test-slave-j2vl krb5kdc[1370](info): commencing operation
krb5kdc: starting...
W20260806 18:42:15.494253 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:42:15 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:42:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:42:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:42:15.645537 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:15.788170 1390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:15.788501 1390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:15.788544 1390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:15.793059 1390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:15.793165 1390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:15.793188 1390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:15.793206 1390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:15.793223 1390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:15.799445 1390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:15.800671 1390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:15.801759 1390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:15.810994 1399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:15.811005 1396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:15.811084 1390 server_base.cc:1034] running on GCE node
W20260806 18:42:15.811017 1395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:15.811986 1390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:15.813314 1390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:15.814590 1390 hybrid_clock.cc:648] HybridClock initialized: now 1786041735814562 us; error 38 us; skew 500 ppm
Aug 06 18:42:15 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041735, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:15.817850 1390 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:15.818953 1390 webserver.cc:460] Webserver started at http://127.12.177.190:38007/ using document root <none> and password file <none>
I20260806 18:42:15.819584 1390 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:15.819684 1390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:15.819944 1390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:15.822361 1390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "16d12ced57a04dc59c82b1e63a4343af"
format_stamp: "Formatted at 2026-08-06 18:42:15 on dist-test-slave-j2vl"
server_key: "d8cf997966e1cd8c633411521686b598"
server_key_iv: "f0a49d6f83caee57b430776f9eeaae07"
server_key_version: "encryptionkey@0"
I20260806 18:42:15.823060 1390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "16d12ced57a04dc59c82b1e63a4343af"
format_stamp: "Formatted at 2026-08-06 18:42:15 on dist-test-slave-j2vl"
server_key: "d8cf997966e1cd8c633411521686b598"
server_key_iv: "f0a49d6f83caee57b430776f9eeaae07"
server_key_version: "encryptionkey@0"
I20260806 18:42:15.828668 1390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:42:15.831982 1407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:15.833585 1390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 18:42:15.833758 1390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "16d12ced57a04dc59c82b1e63a4343af"
format_stamp: "Formatted at 2026-08-06 18:42:15 on dist-test-slave-j2vl"
server_key: "d8cf997966e1cd8c633411521686b598"
server_key_iv: "f0a49d6f83caee57b430776f9eeaae07"
server_key_version: "encryptionkey@0"
I20260806 18:42:15.833914 1390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:15.853557 1390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:15.857820 1390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:15.858211 1390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:15.866952 1390 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35407
I20260806 18:42:15.867312 1485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35407 every 8 connection(s)
I20260806 18:42:15.868156 1390 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:15.871397 1487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:15.876160 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 1390
I20260806 18:42:15.876307 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:42:15.876587 12998 external_mini_cluster.cc:1428] Setting key f2e5b3534ccbe7a6491e3b783cac9fb2
I20260806 18:42:15.878468 1487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap starting.
I20260806 18:42:15.881219 1487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:15.882098 1487 log.cc:824] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:15.884555 1487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: No bootstrap required, opened a new log
Aug 06 18:42:15 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:15.889829 1487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:15.890369 1487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:15.890448 1487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Initialized, Role: FOLLOWER
I20260806 18:42:15.891297 1487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:15.891543 1487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:15.891646 1487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:15.891760 1487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:15.893385 1487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:15.893816 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16d12ced57a04dc59c82b1e63a4343af; no voters:
I20260806 18:42:15.894214 1487 leader_election.cc:288] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:42:15.894344 1495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:15.894444 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:15.878332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51624 (local address 127.12.177.190:35407)
0806 18:42:15.878832 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:15.878849 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:15.878889 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:42:15.879592 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:15.879610 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:15.879976 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:15.880278 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:15.881265 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:15.882499 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:15.883703 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:15.884224 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:15.884361 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:15.887543 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:15.887550 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:15.887567 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:15.887602 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:15.890067 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:15.890799 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:15.890806 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:15.890822 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:15.890958 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:15.891352 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:15.891357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:15.891359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:15.892013 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:15.892273 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:15.892689 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 18:42:15.893182 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":174,"threads_started":1}
I20260806 18:42:15.894523 1495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 LEADER]: Becoming Leader. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Running, Role: LEADER
I20260806 18:42:15.894872 1495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:15.895675 1487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:15.896200 1497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16d12ced57a04dc59c82b1e63a4343af. Latest consensus state: current_term: 1 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:15.896397 1497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:15.896731 1496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:15.896862 1496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:15.897722 1501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:15.900794 1501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:15.907876 1501 catalog_manager.cc:1347] Generated new cluster ID: 58e5fc746e7449d394d636fdb26481b7
I20260806 18:42:15.907982 1501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:15.930985 1501 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:42:15.932425 1501 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:15.942148 1501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Generated new TSK 0
I20260806 18:42:15.943137 1501 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:42:15.982080 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:16.108628 1525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:16.108932 1525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:16.108979 1525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:16.113397 1525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:16.113483 1525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:16.113586 1525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:16.119386 1525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:16.120697 1525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:16.121925 1525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:16.132499 1531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:16.132539 1525 server_base.cc:1034] running on GCE node
W20260806 18:42:16.132479 1533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:16.132477 1537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:16.133307 1525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:16.134053 1525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:16.135301 1525 hybrid_clock.cc:648] HybridClock initialized: now 1786041736135287 us; error 28 us; skew 500 ppm
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:16.138441 1525 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:16.139606 1525 webserver.cc:460] Webserver started at http://127.12.177.129:46563/ using document root <none> and password file <none>
I20260806 18:42:16.140204 1525 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:16.140275 1525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:16.140520 1525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:16.142897 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "c2b28da1f0a676548df92b87348414f7"
server_key_iv: "95ec0df422a139131ea6e29b2deda0de"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.143509 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "c2b28da1f0a676548df92b87348414f7"
server_key_iv: "95ec0df422a139131ea6e29b2deda0de"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.147687 1525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:42:16.150601 1547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.152084 1525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:16.152211 1525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "c2b28da1f0a676548df92b87348414f7"
server_key_iv: "95ec0df422a139131ea6e29b2deda0de"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.152345 1525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:16.167557 1525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:16.171506 1525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:16.171710 1525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:16.172341 1525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:16.173243 1525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:16.173295 1525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.173336 1525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:16.173441 1525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.183445 1525 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:44591
I20260806 18:42:16.183490 1729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:44591 every 8 connection(s)
I20260806 18:42:16.184458 1525 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:16.191452 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 1525
I20260806 18:42:16.191614 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:42:16.191938 12998 external_mini_cluster.cc:1428] Setting key e898a78bda8c5c7ea7d301ad1eae3edd
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:16.204100 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.187017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:41965 (local address 127.12.177.190:35407)
0806 18:42:16.187197 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.187201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.188410 (+ 1209us) server_negotiation.cc:407] Connection header received
0806 18:42:16.190244 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.190247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.190306 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.190380 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:16.192387 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.193127 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.195204 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.195473 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.195581 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.199143 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:16.199150 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:16.199156 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:16.199197 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:16.201155 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.202124 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.202128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.202129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.202219 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.202691 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.202694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.202695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.202919 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:16.203003 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.203811 (+ 808us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.203955 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:42:16.205559 1733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.187493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:41965)
0806 18:42:16.188244 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.188297 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.189811 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.190697 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.190712 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.191269 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:16.192130 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.192155 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.193308 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.193311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.195007 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.195026 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.195674 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.195681 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.195967 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.196845 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:16.196865 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:16.198894 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:16.201335 (+ 2441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.201382 (+ 47us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.201410 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.201981 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.202329 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.202336 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.202339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.202572 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.203041 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:16.203049 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:16.203478 (+ 429us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.203734 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.204187 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":149,"threads_started":1}
I20260806 18:42:16.207242 1731 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:16.207654 1731 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:42:16.208447 1731 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:16.210510 1433 ts_manager.cc:194] Registered new tserver with Master: 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591)
I20260806 18:42:16.211977 1433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:41965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:42:16.230679 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:16.363441 1736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:16.363826 1736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:16.363909 1736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:16.369594 1736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:16.369721 1736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:16.369846 1736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:16.376706 1736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:16.378119 1736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:16.379460 1736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:16.390579 1741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:16.390731 1736 server_base.cc:1034] running on GCE node
W20260806 18:42:16.390640 1743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:16.390579 1747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:16.391480 1736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:16.392432 1736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:16.393729 1736 hybrid_clock.cc:648] HybridClock initialized: now 1786041736393711 us; error 42 us; skew 500 ppm
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:16.397650 1736 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:16.399076 1736 webserver.cc:460] Webserver started at http://127.12.177.130:33905/ using document root <none> and password file <none>
I20260806 18:42:16.399734 1736 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:16.399839 1736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:16.400106 1736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:16.402686 1736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "6a4c4cb4a6c3479a809a85f674120f42"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "f24da8fb713fa6e9e55e468c3e475bf3"
server_key_iv: "c202db6150b8724dd00cb3e1a6f7aaca"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.403343 1736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "6a4c4cb4a6c3479a809a85f674120f42"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "f24da8fb713fa6e9e55e468c3e475bf3"
server_key_iv: "c202db6150b8724dd00cb3e1a6f7aaca"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.407627 1736 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:42:16.410458 1758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.411912 1736 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:16.412070 1736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "6a4c4cb4a6c3479a809a85f674120f42"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "f24da8fb713fa6e9e55e468c3e475bf3"
server_key_iv: "c202db6150b8724dd00cb3e1a6f7aaca"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.412200 1736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:16.432714 1736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:16.436275 1736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:16.436511 1736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:16.437158 1736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:16.438133 1736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:16.438206 1736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.438280 1736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:16.438334 1736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.448710 1736 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:33199
I20260806 18:42:16.448734 1938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:33199 every 8 connection(s)
I20260806 18:42:16.449767 1736 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:16.450135 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 1736
I20260806 18:42:16.450256 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:42:16.450555 12998 external_mini_cluster.cc:1428] Setting key d86782d15b158cc3cf746ca6146d71d9
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:42:16.470209 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.451808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:59751 (local address 127.12.177.190:35407)
0806 18:42:16.452092 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.452097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.453287 (+ 1190us) server_negotiation.cc:407] Connection header received
0806 18:42:16.455063 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.455067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.455120 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.455213 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:16.457048 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.457853 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.459867 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.460114 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.460203 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.464313 (+ 4110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:16.464319 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:16.464324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:16.464367 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:16.466504 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.467559 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.467571 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.467573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.467730 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.468418 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.468422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.468424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.468688 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:16.468807 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.469833 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.470020 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:42:16.471248 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.452534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:59751)
0806 18:42:16.453113 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.453164 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.454768 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.455451 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.455463 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.456076 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:16.456862 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.456886 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.458013 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.458020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.459713 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.459731 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.460327 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.460335 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.460659 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.461476 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:16.461509 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:16.464050 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:16.466712 (+ 2662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.466720 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.466744 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.467261 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.467886 (+ 625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.467890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.467892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.468253 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.469000 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:16.469012 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:16.469493 (+ 481us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.469769 (+ 276us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.470235 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":169,"threads_started":1}
I20260806 18:42:16.473153 1940 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:16.473547 1940 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:16.474295 1940 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:16.475663 1433 ts_manager.cc:194] Registered new tserver with Master: 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199)
I20260806 18:42:16.476351 1433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:59751
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:42:16.489715 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:16.617280 1948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:16.617707 1948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:16.617820 1948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:16.622277 1948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:16.622392 1948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:16.622500 1948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:16.628448 1948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:16.629784 1948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:16.630972 1948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:16.641916 1957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:16.641916 1955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:16.641947 1959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:16.642030 1948 server_base.cc:1034] running on GCE node
I20260806 18:42:16.642692 1948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:16.643368 1948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:16.644562 1948 hybrid_clock.cc:648] HybridClock initialized: now 1786041736644542 us; error 39 us; skew 500 ppm
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:16.647804 1948 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:16.648852 1948 webserver.cc:460] Webserver started at http://127.12.177.131:37727/ using document root <none> and password file <none>
I20260806 18:42:16.649528 1948 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:16.649644 1948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:16.649986 1948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:16.652287 1948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "e999d773947148928d35420f5d4cab24"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "e5db37e4189576d6049711e4fa96e343"
server_key_iv: "dc3ae842cf9d19c55fe68843a6159934"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.652935 1948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "e999d773947148928d35420f5d4cab24"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "e5db37e4189576d6049711e4fa96e343"
server_key_iv: "dc3ae842cf9d19c55fe68843a6159934"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.657284 1948 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:42:16.660174 1970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.661747 1948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:16.661926 1948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "e999d773947148928d35420f5d4cab24"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "e5db37e4189576d6049711e4fa96e343"
server_key_iv: "dc3ae842cf9d19c55fe68843a6159934"
server_key_version: "encryptionkey@0"
I20260806 18:42:16.662066 1948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:16.695329 1948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:16.699301 1948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:16.699540 1948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:16.700205 1948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:16.701170 1948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:16.701251 1948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:16.701323 1948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:16.701401 1948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 18:42:16.711265 1948 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:45413
I20260806 18:42:16.711288 2148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:45413 every 8 connection(s)
I20260806 18:42:16.712306 1948 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:16.719214 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 1948
I20260806 18:42:16.719344 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:42:16.719636 12998 external_mini_cluster.cc:1428] Setting key cff11dce32bf5cfc2ebd3bced0bcc969
Aug 06 18:42:16 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041736, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:16.727365 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.714323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:56911 (local address 127.12.177.190:35407)
0806 18:42:16.714499 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.714503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.715351 (+ 848us) server_negotiation.cc:407] Connection header received
0806 18:42:16.716826 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.716830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.716882 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.717008 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:16.718377 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.719027 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.720598 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.720877 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.721004 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.723737 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:16.723740 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:16.723742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:16.723768 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:16.725044 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.725729 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.725732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.725734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.725817 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.726197 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.726201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.726204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.726401 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:16.726514 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.727058 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.727196 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 18:42:16.728233 2152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.714682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:56911)
0806 18:42:16.715175 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.715226 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.716619 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.717215 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.717222 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.717677 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:16.718202 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.718217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.719176 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.719179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.720426 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.720439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.721049 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.721054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.721234 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.721998 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:16.722015 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:16.723549 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:16.725173 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.725181 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.725199 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.725601 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.725918 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:16.725923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:16.725927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:16.726088 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:16.726512 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:16.726519 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:16.726798 (+ 279us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.726999 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.727359 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":136,"threads_started":1}
I20260806 18:42:16.729763 2149 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:16.730080 2149 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:16.730650 2149 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:16.731853 1433 ts_manager.cc:194] Registered new tserver with Master: e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
I20260806 18:42:16.732553 1433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:56911
I20260806 18:42:16.734124 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:16.744290 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.736222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51632 (local address 127.12.177.190:35407)
0806 18:42:16.736368 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.736371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.736583 (+ 212us) server_negotiation.cc:407] Connection header received
0806 18:42:16.736660 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.736662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.736713 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.736796 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:16.737620 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.738161 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.739108 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.739347 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.739440 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.740884 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:16.740888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:16.740890 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:16.740915 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:16.742451 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.742964 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.742967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.742968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.743054 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:16.743373 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:16.743375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:16.743377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:16.743644 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:16.743756 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.744051 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.744161 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 18:42:16.747538 1432 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:42:16.750746 1432 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:42:16.767686 2175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.760571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38202 (local address 127.12.177.130:33199)
0806 18:42:16.761311 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.761324 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.761553 (+ 229us) server_negotiation.cc:407] Connection header received
0806 18:42:16.761800 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.761808 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.762054 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.762224 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:16.762670 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.763905 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.766048 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.766748 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767074 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767249 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.767375 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.767495 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":122,"threads_started":1}
I20260806 18:42:16.767668 2177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.760416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:33199 (local address 127.0.0.1:38202)
0806 18:42:16.761156 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.761213 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.761561 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.762229 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.762235 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.762262 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:16.762556 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.762565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.764055 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.764059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.765902 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.765915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.767058 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.767177 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767214 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.767341 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.767487 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":292,"thread_start_us":123,"threads_started":1}
I20260806 18:42:16.767877 2170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.760708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:45413 (local address 127.0.0.1:52872)
0806 18:42:16.762818 (+ 2110us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.762833 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.762936 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.763392 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.763396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.763416 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:16.763513 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.763519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.764854 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.764857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.766039 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.766051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.767486 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.767586 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767607 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.767669 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.767737 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2022,"mutex_wait_us":46,"thread_start_us":88,"threads_started":1}
I20260806 18:42:16.767894 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.761368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51428 (local address 127.12.177.129:44591)
0806 18:42:16.762062 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.762068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.762092 (+ 24us) server_negotiation.cc:407] Connection header received
0806 18:42:16.762178 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.762184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.762388 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.762548 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:16.762811 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.763797 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.766073 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.766966 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767103 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767267 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.767609 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.767724 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":140,"threads_started":1}
I20260806 18:42:16.768396 2179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.761390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52872 (local address 127.12.177.131:45413)
0806 18:42:16.761873 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:16.761885 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:16.762948 (+ 1063us) server_negotiation.cc:407] Connection header received
0806 18:42:16.763052 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:16.763057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:16.763230 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:16.763380 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:16.763635 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.764521 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.766222 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.767087 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767295 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767428 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:16.768139 (+ 711us) server_negotiation.cc:299] Negotiation successful
0806 18:42:16.768238 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":124,"threads_started":1}
I20260806 18:42:16.768326 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:16.760438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44591 (local address 127.0.0.1:51428)
0806 18:42:16.761865 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:16.761888 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:16.761986 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:16.762537 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:16.762540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:16.762563 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:16.762677 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.762684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.763921 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.763925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.765902 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:16.765920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:16.767338 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:16.767342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:16.767438 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:16.767470 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 18:42:16.768123 (+ 653us) client_negotiation.cc:240] Negotiation successful
0806 18:42:16.768204 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"mutex_wait_us":257,"spinlock_wait_cycles":12544,"thread_start_us":164,"threads_started":1}
I20260806 18:42:16.771292 1835 tablet_service.cc:1467] Processing CreateTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 (DEFAULT_TABLE table=test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:16.771437 2052 tablet_service.cc:1467] Processing CreateTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 (DEFAULT_TABLE table=test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:16.771423 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 (DEFAULT_TABLE table=test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:16.772454 1835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 550f9a6f0d454f89af3874e2e691d7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:16.772500 2052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 550f9a6f0d454f89af3874e2e691d7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:16.772497 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 550f9a6f0d454f89af3874e2e691d7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:16.779441 2184 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Bootstrap starting.
I20260806 18:42:16.780875 2186 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap starting.
I20260806 18:42:16.781111 2187 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Bootstrap starting.
I20260806 18:42:16.782665 2184 tablet_bootstrap.cc:654] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:16.783330 2187 tablet_bootstrap.cc:654] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:16.783330 2186 tablet_bootstrap.cc:654] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:16.783740 2184 log.cc:824] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:16.784317 2186 log.cc:824] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:16.784703 2187 log.cc:824] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:16.786384 2186 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: No bootstrap required, opened a new log
I20260806 18:42:16.786388 2184 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: No bootstrap required, opened a new log
I20260806 18:42:16.786640 2186 ts_tablet_manager.cc:1397] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:42:16.786643 2184 ts_tablet_manager.cc:1397] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 18:42:16.786844 2187 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: No bootstrap required, opened a new log
I20260806 18:42:16.787038 2187 ts_tablet_manager.cc:1397] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:42:16.791013 2184 raft_consensus.cc:348] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.791373 2184 raft_consensus.cc:374] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:16.791472 2184 raft_consensus.cc:729] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4c4cb4a6c3479a809a85f674120f42, State: Initialized, Role: FOLLOWER
I20260806 18:42:16.791661 2186 raft_consensus.cc:348] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.791976 2186 raft_consensus.cc:374] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:16.792070 2186 raft_consensus.cc:729] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677e814a6edc4b8cb5e7f08edfbc8163, State: Initialized, Role: FOLLOWER
I20260806 18:42:16.792040 2184 consensus_queue.cc:260] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.792142 2187 raft_consensus.cc:348] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.792400 2187 raft_consensus.cc:374] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:16.792514 2187 raft_consensus.cc:729] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e999d773947148928d35420f5d4cab24, State: Initialized, Role: FOLLOWER
I20260806 18:42:16.792563 2186 consensus_queue.cc:260] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.792990 2187 consensus_queue.cc:260] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:16.793124 1940 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
I20260806 18:42:16.793648 2186 ts_tablet_manager.cc:1428] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:42:16.793810 2149 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
I20260806 18:42:16.793960 1731 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
I20260806 18:42:16.794011 2187 ts_tablet_manager.cc:1428] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:42:16.794814 2184 ts_tablet_manager.cc:1428] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260806 18:42:16.936390 1732 tablet.cc:2369] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:16.951401 1942 tablet.cc:2369] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:16.963447 2150 tablet.cc:2369] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:42:17.067960 2195 raft_consensus.cc:482] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:17.068203 2195 raft_consensus.cc:504] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:17.069458 2195 leader_election.cc:288] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
I20260806 18:42:17.073843 2175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.069919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:40339 (local address 127.12.177.130:33199)
0806 18:42:17.070076 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.070081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.070466 (+ 385us) server_negotiation.cc:407] Connection header received
0806 18:42:17.070659 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.070662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.070721 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.070812 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:17.071176 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.071692 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.072791 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.073190 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.073377 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.073444 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.073611 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.073691 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:42:17.073869 2179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.070037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:57169 (local address 127.12.177.131:45413)
0806 18:42:17.070164 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.070169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.070398 (+ 229us) server_negotiation.cc:407] Connection header received
0806 18:42:17.070581 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.070584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.070642 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.070733 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:17.071031 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.071562 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.072785 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.073250 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.073423 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.073484 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.073661 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.073741 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 18:42:17.073909 2198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.069802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:33199 (local address 127.12.177.129:40339)
0806 18:42:17.070345 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.070358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:17.070501 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:17.070853 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:17.070856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:17.070878 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:17.071022 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.071028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.071845 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.071849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.072656 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.072666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.073329 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.073333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.073463 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.073495 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 18:42:17.073594 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 18:42:17.073676 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":83,"thread_start_us":91,"threads_started":1}
I20260806 18:42:17.073909 2201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.069802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:45413 (local address 127.12.177.129:57169)
0806 18:42:17.070278 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.070291 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:17.070451 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:17.070748 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:17.070751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:17.070769 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:17.070915 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.070921 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.071692 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.071699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.072652 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.072662 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.073404 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.073408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.073521 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.073543 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:42:17.073645 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 18:42:17.073720 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":23,"thread_start_us":130,"threads_started":1}
I20260806 18:42:17.074679 1865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "550f9a6f0d454f89af3874e2e691d7f4" candidate_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4c4cb4a6c3479a809a85f674120f42" is_pre_election: true
I20260806 18:42:17.075106 1865 raft_consensus.cc:2454] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677e814a6edc4b8cb5e7f08edfbc8163 in term 0.
I20260806 18:42:17.075137 2080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "550f9a6f0d454f89af3874e2e691d7f4" candidate_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e999d773947148928d35420f5d4cab24" is_pre_election: true
I20260806 18:42:17.075469 2080 raft_consensus.cc:2454] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677e814a6edc4b8cb5e7f08edfbc8163 in term 0.
I20260806 18:42:17.075726 1553 leader_election.cc:302] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163, 6a4c4cb4a6c3479a809a85f674120f42; no voters:
I20260806 18:42:17.076078 2195 raft_consensus.cc:2781] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:17.076166 2195 raft_consensus.cc:482] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:17.076221 2195 raft_consensus.cc:3037] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:17.077432 2195 raft_consensus.cc:504] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:17.077862 2195 leader_election.cc:288] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 1 election: Requested vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
I20260806 18:42:17.078325 2080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "550f9a6f0d454f89af3874e2e691d7f4" candidate_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e999d773947148928d35420f5d4cab24"
I20260806 18:42:17.078368 1865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "550f9a6f0d454f89af3874e2e691d7f4" candidate_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4c4cb4a6c3479a809a85f674120f42"
I20260806 18:42:17.078462 2080 raft_consensus.cc:3037] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:17.078534 1865 raft_consensus.cc:3037] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:17.079697 1865 raft_consensus.cc:2454] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677e814a6edc4b8cb5e7f08edfbc8163 in term 1.
I20260806 18:42:17.079702 2080 raft_consensus.cc:2454] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677e814a6edc4b8cb5e7f08edfbc8163 in term 1.
I20260806 18:42:17.080082 1551 leader_election.cc:302] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163, e999d773947148928d35420f5d4cab24; no voters:
I20260806 18:42:17.080313 2195 raft_consensus.cc:2781] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:17.080642 2195 raft_consensus.cc:686] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 LEADER]: Becoming Leader. State: Replica: 677e814a6edc4b8cb5e7f08edfbc8163, State: Running, Role: LEADER
I20260806 18:42:17.081090 2195 consensus_queue.cc:237] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:17.084892 1426 catalog_manager.cc:5495] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 reported cstate change: term changed from 0 to 1, leader changed from <none> to 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129). New cstate: current_term: 1 leader_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } health_report { overall_health: UNKNOWN } } }
I20260806 18:42:17.140441 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.136633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51434 (local address 127.12.177.129:44591)
0806 18:42:17.136793 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.136800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.136831 (+ 31us) server_negotiation.cc:407] Connection header received
0806 18:42:17.136930 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.136932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.136992 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.137109 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:17.137414 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.137951 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.138842 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.139076 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.139191 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.139533 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:17.140016 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:17.140160 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.140202 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.140281 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:42:17.146983 1865 raft_consensus.cc:1261] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Refusing update from remote peer 677e814a6edc4b8cb5e7f08edfbc8163: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:17.146983 2080 raft_consensus.cc:1261] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Refusing update from remote peer 677e814a6edc4b8cb5e7f08edfbc8163: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:17.147878 2202 consensus_queue.cc:1035] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:17.148098 2195 consensus_queue.cc:1035] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:17.158172 2210 mvcc.cc:205] Tried to move back new op lower bound from 7315626955345657856 to 7315626955087282176. Current Snapshot: MvccSnapshot[applied={T|T < 7315626955345657856}]
I20260806 18:42:17.167374 1426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:17.167616 1426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:17.170300 1426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Sending DeleteTablet for 3 replicas of tablet 550f9a6f0d454f89af3874e2e691d7f4
I20260806 18:42:17.171295 1626 tablet_service.cc:1514] Processing DeleteTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:17 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51428
I20260806 18:42:17.171650 2052 tablet_service.cc:1514] Processing DeleteTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:17 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:52872
I20260806 18:42:17.171816 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 1525
I20260806 18:42:17.171958 1835 tablet_service.cc:1514] Processing DeleteTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:17 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:38202
I20260806 18:42:17.179035 2225 tablet_replica.cc:330] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: stopping tablet replica
I20260806 18:42:17.180881 2225 raft_consensus.cc:2229] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:17.182022 2225 raft_consensus.cc:2258] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:17.184425 2224 tablet_replica.cc:330] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: stopping tablet replica
I20260806 18:42:17.185062 2224 raft_consensus.cc:2229] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:17.185674 2224 raft_consensus.cc:2258] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:17.187000 2225 ts_tablet_manager.cc:1905] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:17.189304 2224 ts_tablet_manager.cc:1905] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:17.190600 2225 ts_tablet_manager.cc:1918] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:17.190740 2225 log.cc:1196] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/550f9a6f0d454f89af3874e2e691d7f4
I20260806 18:42:17.191224 2225 ts_tablet_manager.cc:1939] T 550f9a6f0d454f89af3874e2e691d7f4 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting consensus metadata
I20260806 18:42:17.192432 2224 ts_tablet_manager.cc:1918] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:17.192553 2224 log.cc:1196] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/550f9a6f0d454f89af3874e2e691d7f4
I20260806 18:42:17.192934 2224 ts_tablet_manager.cc:1939] T 550f9a6f0d454f89af3874e2e691d7f4 P e999d773947148928d35420f5d4cab24: Deleting consensus metadata
I20260806 18:42:17.192935 1413 catalog_manager.cc:4841] TS 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): tablet 550f9a6f0d454f89af3874e2e691d7f4 (table test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]) successfully deleted
I20260806 18:42:17.194205 1408 catalog_manager.cc:4841] TS e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): tablet 550f9a6f0d454f89af3874e2e691d7f4 (table test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]) successfully deleted
W20260806 18:42:17.195043 1411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:44591 (error 108)
I20260806 18:42:17.195850 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 1736
I20260806 18:42:17.208684 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.206836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44591 (local address 127.0.0.1:51446)
0806 18:42:17.208417 (+ 1581us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.208548 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1426}
W20260806 18:42:17.209117 1411 catalog_manager.cc:4584] TS 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 550f9a6f0d454f89af3874e2e691d7f4: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44591: connect: Connection refused (error 111)
I20260806 18:42:17.216284 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 1948
I20260806 18:42:17.237660 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 1390
I20260806 18:42:17.254348 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--webserver_interface=127.12.177.190
--webserver_port=38007
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:17.379992 2228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:17.380386 2228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:17.380493 2228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:17.385053 2228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:17.385165 2228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:17.385205 2228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:17.385267 2228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:17.385308 2228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:17.391099 2228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=38007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:17.392467 2228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:17.393625 2228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:17.410557 2242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:17.410581 2240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:17.410581 2244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:17.411057 2228 server_base.cc:1034] running on GCE node
I20260806 18:42:17.411808 2228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:17.413203 2228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:17.414430 2228 hybrid_clock.cc:648] HybridClock initialized: now 1786041737414415 us; error 32 us; skew 500 ppm
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:17.417758 2228 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:17.418996 2228 webserver.cc:460] Webserver started at http://127.12.177.190:38007/ using document root <none> and password file <none>
I20260806 18:42:17.419684 2228 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:17.419823 2228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:17.424754 2228 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:17.427575 2253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:17.429137 2228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:17.429327 2228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "16d12ced57a04dc59c82b1e63a4343af"
format_stamp: "Formatted at 2026-08-06 18:42:15 on dist-test-slave-j2vl"
server_key: "d8cf997966e1cd8c633411521686b598"
server_key_iv: "f0a49d6f83caee57b430776f9eeaae07"
server_key_version: "encryptionkey@0"
I20260806 18:42:17.430143 2228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:17.443488 2228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:17.447116 2228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:17.447368 2228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:17.455358 2228 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35407
I20260806 18:42:17.455708 2335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35407 every 8 connection(s)
I20260806 18:42:17.456624 2228 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:17.461275 2336 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:42:17.463095 2336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap starting.
I20260806 18:42:17.463775 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 2228
I20260806 18:42:17.464274 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:44591
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=46563
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:17.483976 2336 log.cc:824] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:17.494575 2336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:17.495093 2336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap complete.
I20260806 18:42:17.500214 2336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:17.500717 2336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Initialized, Role: FOLLOWER
I20260806 18:42:17.501314 2336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:17.501539 2336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:17.501644 2336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:17.501767 2336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:42:17.504112 2336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:17.504531 2336 leader_election.cc:302] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16d12ced57a04dc59c82b1e63a4343af; no voters:
I20260806 18:42:17.504961 2336 leader_election.cc:288] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 18:42:17.505097 2341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Leader election won for term 2
I20260806 18:42:17.505429 2341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 LEADER]: Becoming Leader. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Running, Role: LEADER
I20260806 18:42:17.505801 2341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:17.506433 2336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:17.506964 2341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16d12ced57a04dc59c82b1e63a4343af. Latest consensus state: current_term: 2 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:17.507099 2341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:17.507771 2343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:17.507896 2343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:17.508370 2349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:17.514609 2349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:17.516687 2349 catalog_manager.cc:1259] Loaded cluster ID: 58e5fc746e7449d394d636fdb26481b7
I20260806 18:42:17.516824 2349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:17.518719 2349 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 18:42:17.523102 2349 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 18:42:17.530007 2349 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:17.531019 2349 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Loaded TSK: 0
I20260806 18:42:17.532755 2349 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:42:17.602608 2339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:17.602942 2339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:17.602993 2339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:17.608301 2339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:17.608395 2339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:17.608496 2339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:17.614807 2339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:44591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=46563
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:17.616050 2339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:17.617215 2339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:17.629000 2383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:17.629002 2382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:17.629000 2386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:17.629293 2339 server_base.cc:1034] running on GCE node
I20260806 18:42:17.629865 2339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:17.630615 2339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:17.631829 2339 hybrid_clock.cc:648] HybridClock initialized: now 1786041737631798 us; error 50 us; skew 500 ppm
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:17.635241 2339 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:17.636415 2339 webserver.cc:460] Webserver started at http://127.12.177.129:46563/ using document root <none> and password file <none>
I20260806 18:42:17.637076 2339 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:17.637164 2339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:17.641883 2339 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:42:17.644430 2395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:17.646077 2339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:17.646245 2339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "c2b28da1f0a676548df92b87348414f7"
server_key_iv: "95ec0df422a139131ea6e29b2deda0de"
server_key_version: "encryptionkey@0"
I20260806 18:42:17.646898 2339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:17.671144 2339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:17.674974 2339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:17.675213 2339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:17.675911 2339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:17.677102 2403 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 18:42:17.681818 2339 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 18:42:17.681944 2339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 18:42:17.682063 2339 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 18:42:17.683995 2339 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 18:42:17.684077 2339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 18:42:17.684454 2403 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap starting.
I20260806 18:42:17.696064 2339 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:44591
I20260806 18:42:17.696173 2563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:44591 every 8 connection(s)
I20260806 18:42:17.697180 2339 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:17.703946 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 2339
I20260806 18:42:17.704394 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:33199
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=33905
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:17.706928 2403 log.cc:824] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:17.717048 2403 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:17.717593 2403 tablet_bootstrap.cc:492] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap complete.
I20260806 18:42:17.719283 2403 ts_tablet_manager.cc:1397] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.010s
I20260806 18:42:17.719580 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.699785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:46185)
0806 18:42:17.700639 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.700719 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:17.701943 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:17.703164 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:17.703174 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:17.703695 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:17.704524 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.704548 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.706476 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.706482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.708016 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.708034 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.709175 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.709180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.709426 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.710172 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:17.710194 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:17.712302 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:17.715405 (+ 3103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.715410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.715424 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.715785 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.716280 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.716283 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.716285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.716469 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.717385 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:17.717394 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:17.717724 (+ 330us) client_negotiation.cc:769] Sending connection context
0806 18:42:17.717935 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 18:42:17.718333 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":161,"threads_started":1}
I20260806 18:42:17.719745 2568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.699783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:46185 (local address 127.12.177.190:35407)
0806 18:42:17.700261 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.700281 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.700878 (+ 597us) server_negotiation.cc:407] Connection header received
0806 18:42:17.702383 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.702395 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.702722 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.703016 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:17.704749 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.706278 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.708181 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.708984 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.709193 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.712598 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:17.712609 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:17.712632 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:17.712683 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:17.715246 (+ 2563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.715940 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.715950 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.715958 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.716155 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.716590 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.716596 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.716601 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.717215 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:17.717413 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.718106 (+ 693us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.718655 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":170,"threads_started":1}
I20260806 18:42:17.722926 2564 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:17.723204 2564 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:17.722693 2403 raft_consensus.cc:348] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:17.723349 2403 raft_consensus.cc:729] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677e814a6edc4b8cb5e7f08edfbc8163, State: Initialized, Role: FOLLOWER
I20260806 18:42:17.723853 2564 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:17.723881 2403 consensus_queue.cc:260] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } }
I20260806 18:42:17.725030 2403 ts_tablet_manager.cc:1428] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:42:17.726871 2282 ts_manager.cc:194] Registered new tserver with Master: 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591)
I20260806 18:42:17.731297 2282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:46185
I20260806 18:42:17.734300 2564 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:42:17.743081 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.730612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44591 (local address 127.0.0.1:51458)
0806 18:42:17.731353 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.731408 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:17.731572 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:17.732101 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:17.732107 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:17.732552 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:17.732726 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.732736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.734264 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.734268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.735243 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.735254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.736124 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.736127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.736258 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.736936 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:17.736949 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:17.738655 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:17.741050 (+ 2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.741062 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.741067 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.741453 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.741814 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.741817 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.741819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.741910 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.742485 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:17.742490 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:17.742614 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 18:42:17.742734 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 18:42:17.742930 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":137,"threads_started":1}
I20260806 18:42:17.743240 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.730725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51458 (local address 127.12.177.129:44591)
0806 18:42:17.731519 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.731532 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.731558 (+ 26us) server_negotiation.cc:407] Connection header received
0806 18:42:17.731759 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.731763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.731944 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.732098 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:17.732872 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.734129 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.735380 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.735984 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.736090 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.738840 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:17.738854 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:17.738869 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:17.738899 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:17.740882 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.741594 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.741600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.741602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.741711 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.742006 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.742009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.742011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.742367 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:17.742508 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.742854 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.743053 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":683,"thread_start_us":117,"threads_started":1}
I20260806 18:42:17.744537 2466 tablet_service.cc:1514] Processing DeleteTablet for tablet 550f9a6f0d454f89af3874e2e691d7f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:17 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51458
I20260806 18:42:17.745527 2577 tablet_replica.cc:330] stopping tablet replica
I20260806 18:42:17.745865 2577 raft_consensus.cc:2229] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:17.746153 2577 raft_consensus.cc:2258] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:17.747217 2577 ts_tablet_manager.cc:1905] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:17.751322 2577 ts_tablet_manager.cc:1918] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:17.751464 2577 log.cc:1196] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/550f9a6f0d454f89af3874e2e691d7f4
I20260806 18:42:17.751843 2577 ts_tablet_manager.cc:1939] T 550f9a6f0d454f89af3874e2e691d7f4 P 677e814a6edc4b8cb5e7f08edfbc8163: Deleting consensus metadata
I20260806 18:42:17.753741 2257 catalog_manager.cc:4841] TS 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591): tablet 550f9a6f0d454f89af3874e2e691d7f4 (table test-table [id=5d5b5feae1c542f093dc2ea21f99f7f2]) successfully deleted
W20260806 18:42:17.842623 2570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:17.842943 2570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:17.842993 2570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:17.847335 2570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:17.847425 2570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:17.847491 2570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:17.853475 2570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:33199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=33905
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:17.854638 2570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:17.855885 2570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:17.867669 2587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:17.867748 2570 server_base.cc:1034] running on GCE node
W20260806 18:42:17.867645 2583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:17.867638 2584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:17.868410 2570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:17.869202 2570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:17.870425 2570 hybrid_clock.cc:648] HybridClock initialized: now 1786041737870410 us; error 30 us; skew 500 ppm
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:17.873721 2570 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:17.874749 2570 webserver.cc:460] Webserver started at http://127.12.177.130:33905/ using document root <none> and password file <none>
I20260806 18:42:17.875335 2570 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:17.875420 2570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:17.879743 2570 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:42:17.882088 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:17.883667 2570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:17.883833 2570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "6a4c4cb4a6c3479a809a85f674120f42"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "f24da8fb713fa6e9e55e468c3e475bf3"
server_key_iv: "c202db6150b8724dd00cb3e1a6f7aaca"
server_key_version: "encryptionkey@0"
I20260806 18:42:17.884465 2570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:17.901063 2570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:17.904676 2570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:17.904940 2570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:17.905727 2570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:17.906767 2570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:17.906818 2570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:17.906860 2570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:17.906916 2570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:17.917541 2570 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:33199
I20260806 18:42:17.917567 2768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:33199 every 8 connection(s)
I20260806 18:42:17.918632 2570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:17.924861 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 2570
I20260806 18:42:17.925400 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:45413
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=37727
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:42:17 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041737, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:17.935499 2568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.920634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:38655 (local address 127.12.177.190:35407)
0806 18:42:17.920785 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:17.920788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:17.921686 (+ 898us) server_negotiation.cc:407] Connection header received
0806 18:42:17.923130 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:17.923133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:17.923189 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:17.923269 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:17.924581 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.925471 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.926801 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.927239 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.927376 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.930734 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:17.930738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:17.930740 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:17.930770 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:17.932368 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.933131 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.933136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.933139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.933243 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:17.933904 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:17.933911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:17.933913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:17.934142 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:17.934262 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:17.935093 (+ 831us) server_negotiation.cc:299] Negotiation successful
0806 18:42:17.935268 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:42:17.936529 2773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:17.920966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:38655)
0806 18:42:17.921517 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:17.921562 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:17.922917 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:17.923469 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:17.923476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:17.923871 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:17.924390 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.924404 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.925684 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.925687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.926648 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:17.926660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:17.927491 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:17.927498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:17.927763 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:17.928513 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:17.928540 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:17.930518 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:17.932532 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.932539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.932561 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.932892 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.933387 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:17.933392 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:17.933395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:17.933790 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:17.934266 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:17.934277 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:17.934694 (+ 417us) client_negotiation.cc:769] Sending connection context
0806 18:42:17.935016 (+ 322us) client_negotiation.cc:240] Negotiation successful
0806 18:42:17.935432 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":128,"threads_started":1}
I20260806 18:42:17.937942 2770 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:17.938251 2770 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:17.938834 2770 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:17.940075 2282 ts_manager.cc:194] Registered new tserver with Master: 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199)
I20260806 18:42:17.940899 2282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:38655
W20260806 18:42:18.053066 2774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:18.053424 2774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:18.053505 2774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:18.059082 2774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:18.059229 2774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:18.059356 2774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:18.066627 2774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:45413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=37727
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:18.067904 2774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:18.069029 2774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:18.079932 2786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.079932 2783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.080042 2784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:18.079993 2774 server_base.cc:1034] running on GCE node
I20260806 18:42:18.080713 2774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:18.081487 2774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:18.082681 2774 hybrid_clock.cc:648] HybridClock initialized: now 1786041738082645 us; error 50 us; skew 500 ppm
Aug 06 18:42:18 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:18.085899 2774 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:18.086846 2774 webserver.cc:460] Webserver started at http://127.12.177.131:37727/ using document root <none> and password file <none>
I20260806 18:42:18.087431 2774 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:18.087543 2774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:18.091681 2774 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:42:18.093957 2795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:18.095278 2774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:18.095425 2774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "e999d773947148928d35420f5d4cab24"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "e5db37e4189576d6049711e4fa96e343"
server_key_iv: "dc3ae842cf9d19c55fe68843a6159934"
server_key_version: "encryptionkey@0"
I20260806 18:42:18.096019 2774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:18.112289 2774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:18.116014 2774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:18.116247 2774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:18.116950 2774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:18.117974 2774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:18.118057 2774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:18.118151 2774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:18.118199 2774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:18.128504 2774 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:45413
I20260806 18:42:18.128588 2966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:45413 every 8 connection(s)
I20260806 18:42:18.129791 2774 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:18.135134 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 2774
Aug 06 18:42:18 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:18.145480 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.135951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.12.177.190:35407)
0806 18:42:18.136244 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.136249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.136392 (+ 143us) server_negotiation.cc:407] Connection header received
0806 18:42:18.136549 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.136552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.136603 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.136698 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:18.138196 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.138657 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.139591 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.139907 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.140025 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.141590 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:18.141595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:18.141601 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:18.141641 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:18.143377 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:18.143971 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:18.143978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:18.143980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:18.144089 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:18.144451 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:18.144454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:18.144455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:18.144661 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:18.144821 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.145099 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.145244 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":105,"threads_started":1}
I20260806 18:42:18.147769 2568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.131966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:41051 (local address 127.12.177.190:35407)
0806 18:42:18.132137 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.132141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.133084 (+ 943us) server_negotiation.cc:407] Connection header received
0806 18:42:18.135646 (+ 2562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.135649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.135709 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.135848 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:18.137543 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.138091 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.139465 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.139765 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.139845 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.143283 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:18.143286 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:18.143288 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:18.143326 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:18.144897 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:18.145706 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:18.145713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:18.145714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:18.145798 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:18.146291 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:18.146295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:18.146297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:18.146534 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:18.146642 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.147404 (+ 762us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.147599 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:42:18.148643 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.132336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:41051)
0806 18:42:18.132900 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.132947 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:18.134612 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:18.136129 (+ 1517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:18.136140 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:18.136662 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:18.137293 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.137311 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.138234 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.138237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.139330 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.139341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.139969 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.139978 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.140215 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.140958 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:18.140979 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:18.143073 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:18.145055 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:18.145062 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:18.145082 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:18.145565 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:18.145933 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:18.145936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:18.145938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:18.146189 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:18.146661 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:18.146667 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:18.147066 (+ 399us) client_negotiation.cc:769] Sending connection context
0806 18:42:18.147294 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 18:42:18.147721 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":135,"threads_started":1}
I20260806 18:42:18.150072 2967 heartbeater.cc:347] Connected to a master server at 127.12.177.190:35407
I20260806 18:42:18.150336 2967 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:18.150923 2967 heartbeater.cc:511] Master 127.12.177.190:35407 requested a full tablet report, sending...
I20260806 18:42:18.152089 2282 ts_manager.cc:194] Registered new tserver with Master: e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
I20260806 18:42:18.152668 2282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:41051
I20260806 18:42:18.159961 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:18.164858 2568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.160677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51648 (local address 127.12.177.190:35407)
0806 18:42:18.160884 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.160890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.161056 (+ 166us) server_negotiation.cc:407] Connection header received
0806 18:42:18.161273 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.161276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.161470 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.161592 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:18.161876 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.162414 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.163315 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.163550 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.163664 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.164003 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:18.164444 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:18.164584 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.164626 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.164691 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 18:42:18.165776 2282 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:42:18.169314 2282 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:42:18.179018 2466 tablet_service.cc:1467] Processing CreateTablet for tablet 895ae123b67a45ca895e3830c3b65976 (DEFAULT_TABLE table=test-table [id=6a2014b088f4424683de6848158de11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:18.179786 2466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ae123b67a45ca895e3830c3b65976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:18.182811 2403 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap starting.
I20260806 18:42:18.183894 2403 tablet_bootstrap.cc:654] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:18.183957 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.178109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:45413 (local address 127.0.0.1:52880)
0806 18:42:18.178587 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.178601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:18.178688 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:18.179457 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:18.179460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:18.179480 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:18.179594 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.179600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.181109 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.181113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.182289 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.182299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.183553 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.183557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.183664 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.183691 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:42:18.183732 (+ 41us) client_negotiation.cc:240] Negotiation successful
0806 18:42:18.183783 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":22,"thread_start_us":139,"threads_started":1}
I20260806 18:42:18.183957 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.177873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:33199 (local address 127.0.0.1:38218)
0806 18:42:18.178052 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.178067 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:18.178156 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:18.179160 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:18.179163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:18.179182 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:18.179313 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.179324 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.180825 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.180831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.182213 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.182226 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.183422 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.183427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.183551 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.183609 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 18:42:18.183676 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 18:42:18.183775 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":41}
I20260806 18:42:18.184098 2982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.178047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.12.177.130:33199)
0806 18:42:18.178586 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.178600 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.178628 (+ 28us) server_negotiation.cc:407] Connection header received
0806 18:42:18.178720 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.178728 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.178994 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.179183 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:18.179555 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.180675 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.182388 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.183271 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.183411 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.183674 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.183779 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.183904 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":188,"threads_started":1}
I20260806 18:42:18.185134 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.178575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52880 (local address 127.12.177.131:45413)
0806 18:42:18.178974 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.178986 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.179008 (+ 22us) server_negotiation.cc:407] Connection header received
0806 18:42:18.179089 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.179094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.179291 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.179759 (+ 468us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:18.179939 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.180959 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.182433 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.183422 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.184611 (+ 1189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.184766 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.184825 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.184934 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":171,"threads_started":1}
I20260806 18:42:18.185516 2403 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: No bootstrap required, opened a new log
I20260806 18:42:18.185640 2403 ts_tablet_manager.cc:1397] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:18.186160 2403 raft_consensus.cc:348] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.186292 2403 raft_consensus.cc:374] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:18.186749 2403 raft_consensus.cc:729] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677e814a6edc4b8cb5e7f08edfbc8163, State: Initialized, Role: FOLLOWER
I20260806 18:42:18.187076 2403 consensus_queue.cc:260] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.187425 2403 ts_tablet_manager.cc:1428] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 18:42:18.187597 2671 tablet_service.cc:1467] Processing CreateTablet for tablet 895ae123b67a45ca895e3830c3b65976 (DEFAULT_TABLE table=test-table [id=6a2014b088f4424683de6848158de11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:18.188277 2870 tablet_service.cc:1467] Processing CreateTablet for tablet 895ae123b67a45ca895e3830c3b65976 (DEFAULT_TABLE table=test-table [id=6a2014b088f4424683de6848158de11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:18.188767 2671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ae123b67a45ca895e3830c3b65976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:18.189209 2870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ae123b67a45ca895e3830c3b65976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:18.196604 2988 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Bootstrap starting.
I20260806 18:42:18.197194 2987 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Bootstrap starting.
W20260806 18:42:18.198482 2567 tablet.cc:2369] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:42:18.199815 2987 tablet_bootstrap.cc:654] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:18.199815 2988 tablet_bootstrap.cc:654] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:18.200773 2987 log.cc:824] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:18.200767 2988 log.cc:824] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:18.202775 2988 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: No bootstrap required, opened a new log
I20260806 18:42:18.202785 2987 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: No bootstrap required, opened a new log
I20260806 18:42:18.202989 2987 ts_tablet_manager.cc:1397] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:42:18.202997 2988 ts_tablet_manager.cc:1397] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:42:18.206084 2988 raft_consensus.cc:348] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.206115 2987 raft_consensus.cc:348] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.206347 2988 raft_consensus.cc:374] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:18.206374 2987 raft_consensus.cc:374] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:18.206434 2988 raft_consensus.cc:729] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4c4cb4a6c3479a809a85f674120f42, State: Initialized, Role: FOLLOWER
I20260806 18:42:18.206434 2987 raft_consensus.cc:729] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e999d773947148928d35420f5d4cab24, State: Initialized, Role: FOLLOWER
I20260806 18:42:18.206884 2988 consensus_queue.cc:260] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.206919 2987 consensus_queue.cc:260] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.207648 2770 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
I20260806 18:42:18.207707 2967 heartbeater.cc:503] Master 127.12.177.190:35407 was elected leader, sending a full tablet report...
I20260806 18:42:18.208576 2988 ts_tablet_manager.cc:1428] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 18:42:18.208921 2987 ts_tablet_manager.cc:1428] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260806 18:42:18.381073 2968 tablet.cc:2369] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:42:18.420075 2772 tablet.cc:2369] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:42:18.431922 2994 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:18.432148 2994 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.433503 2994 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591)
I20260806 18:42:18.437597 2982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.433830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:51539 (local address 127.12.177.130:33199)
0806 18:42:18.434066 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.434071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.434088 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:42:18.434247 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.434250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.434312 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.434405 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:18.434691 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.435300 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.436380 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.436788 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.436924 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.436987 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.437182 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.437460 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260806 18:42:18.437595 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.433739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:33199 (local address 127.12.177.131:51539)
0806 18:42:18.433967 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.433984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:18.434094 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:18.434421 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:18.434425 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:18.434446 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:18.434571 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.434576 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.435433 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.435437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.436241 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.436250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.436923 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.436926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.437046 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.437066 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:42:18.437163 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 18:42:18.437430 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260806 18:42:18.438241 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.433817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44591 (local address 127.12.177.131:50141)
0806 18:42:18.434399 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.434411 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:18.434542 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:18.434894 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:18.434897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:18.434914 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:18.435043 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.435049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.435868 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.435873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.436665 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:18.436675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.437768 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.437774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:18.437895 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.437918 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:42:18.437991 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 18:42:18.438067 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":147,"threads_started":1}
I20260806 18:42:18.438467 2701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ae123b67a45ca895e3830c3b65976" candidate_uuid: "e999d773947148928d35420f5d4cab24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4c4cb4a6c3479a809a85f674120f42" is_pre_election: true
I20260806 18:42:18.438668 2997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.433969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:50141 (local address 127.12.177.129:44591)
0806 18:42:18.434335 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.434340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.434504 (+ 164us) server_negotiation.cc:407] Connection header received
0806 18:42:18.434671 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.434674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.434741 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.434884 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:18.435169 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.435737 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.436808 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.437279 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.437481 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.437675 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.438427 (+ 752us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.438536 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":140,"threads_started":1}
I20260806 18:42:18.438854 2701 raft_consensus.cc:2454] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e999d773947148928d35420f5d4cab24 in term 0.
I20260806 18:42:18.439262 2496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ae123b67a45ca895e3830c3b65976" candidate_uuid: "e999d773947148928d35420f5d4cab24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" is_pre_election: true
I20260806 18:42:18.439363 2799 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24; no voters:
I20260806 18:42:18.439560 2496 raft_consensus.cc:2454] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e999d773947148928d35420f5d4cab24 in term 0.
I20260806 18:42:18.439743 2994 raft_consensus.cc:2781] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:18.439855 2994 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:18.439914 2994 raft_consensus.cc:3037] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:18.441089 2994 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.441533 2994 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [CANDIDATE]: Term 1 election: Requested vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591)
I20260806 18:42:18.442047 2701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ae123b67a45ca895e3830c3b65976" candidate_uuid: "e999d773947148928d35420f5d4cab24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4c4cb4a6c3479a809a85f674120f42"
I20260806 18:42:18.442049 2496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ae123b67a45ca895e3830c3b65976" candidate_uuid: "e999d773947148928d35420f5d4cab24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
I20260806 18:42:18.442204 2496 raft_consensus.cc:3037] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:18.442205 2701 raft_consensus.cc:3037] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:18.443668 2701 raft_consensus.cc:2454] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e999d773947148928d35420f5d4cab24 in term 1.
I20260806 18:42:18.443668 2496 raft_consensus.cc:2454] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e999d773947148928d35420f5d4cab24 in term 1.
I20260806 18:42:18.444067 2798 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163, e999d773947148928d35420f5d4cab24; no voters:
I20260806 18:42:18.444348 2994 raft_consensus.cc:2781] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:18.444622 2994 raft_consensus.cc:686] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 1 LEADER]: Becoming Leader. State: Replica: e999d773947148928d35420f5d4cab24, State: Running, Role: LEADER
I20260806 18:42:18.445029 2994 consensus_queue.cc:237] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:18.448639 2282 catalog_manager.cc:5495] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 reported cstate change: term changed from 0 to 1, leader changed from <none> to e999d773947148928d35420f5d4cab24 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "e999d773947148928d35420f5d4cab24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } health_report { overall_health: UNKNOWN } } }
I20260806 18:42:18.481840 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.477961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52888 (local address 127.12.177.131:45413)
0806 18:42:18.478123 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:18.478128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:18.478146 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:42:18.478267 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:18.478269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:18.478330 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:18.478480 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:18.478729 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.479253 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.480119 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:18.480346 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:18.480495 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:18.480867 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:18.481429 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:18.481567 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:18.481611 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 18:42:18.481679 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:42:18.488996 2701 raft_consensus.cc:1261] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Refusing update from remote peer e999d773947148928d35420f5d4cab24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:18.488996 2496 raft_consensus.cc:1261] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Refusing update from remote peer e999d773947148928d35420f5d4cab24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:18.490018 2994 consensus_queue.cc:1035] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:18.490288 3000 consensus_queue.cc:1035] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:18.498306 3004 mvcc.cc:205] Tried to move back new op lower bound from 7315626960841150464 to 7315626960674066432. Current Snapshot: MvccSnapshot[applied={T|T < 7315626960841150464}]
I20260806 18:42:18.498507 3006 mvcc.cc:205] Tried to move back new op lower bound from 7315626960841150464 to 7315626960674066432. Current Snapshot: MvccSnapshot[applied={T|T < 7315626960841150464}]
I20260806 18:42:18.502718 3007 mvcc.cc:205] Tried to move back new op lower bound from 7315626960841150464 to 7315626960674066432. Current Snapshot: MvccSnapshot[applied={T|T < 7315626960841150464 or (T in {7315626960841150464})}]
I20260806 18:42:18.507937 2274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:18.508159 2274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:18.511237 2274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Sending DeleteTablet for 3 replicas of tablet 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:18.512288 2466 tablet_service.cc:1514] Processing DeleteTablet for tablet 895ae123b67a45ca895e3830c3b65976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:18 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:51458
I20260806 18:42:18.512363 2671 tablet_service.cc:1514] Processing DeleteTablet for tablet 895ae123b67a45ca895e3830c3b65976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:18 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:38218
I20260806 18:42:18.512356 2870 tablet_service.cc:1514] Processing DeleteTablet for tablet 895ae123b67a45ca895e3830c3b65976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:18 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:52880
I20260806 18:42:18.512678 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 2339
I20260806 18:42:18.512790 3018 tablet_replica.cc:330] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: stopping tablet replica
I20260806 18:42:18.512961 3018 raft_consensus.cc:2229] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:18.517606 3023 tablet_replica.cc:330] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: stopping tablet replica
I20260806 18:42:18.518077 3023 raft_consensus.cc:2229] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:42:18.518590 3023 raft_consensus.cc:2258] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:18.519133 3021 tablet_replica.cc:330] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: stopping tablet replica
I20260806 18:42:18.519529 3021 raft_consensus.cc:2229] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:18.519883 3021 raft_consensus.cc:2258] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:18.524472 3021 ts_tablet_manager.cc:1905] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:18.524472 3023 ts_tablet_manager.cc:1905] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:18.527740 3021 ts_tablet_manager.cc:1918] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:18.527750 3023 ts_tablet_manager.cc:1918] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:18.527899 3021 log.cc:1196] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/895ae123b67a45ca895e3830c3b65976
I20260806 18:42:18.528087 3023 log.cc:1196] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/895ae123b67a45ca895e3830c3b65976
I20260806 18:42:18.528316 3021 ts_tablet_manager.cc:1939] T 895ae123b67a45ca895e3830c3b65976 P 6a4c4cb4a6c3479a809a85f674120f42: Deleting consensus metadata
I20260806 18:42:18.528618 3023 ts_tablet_manager.cc:1939] T 895ae123b67a45ca895e3830c3b65976 P e999d773947148928d35420f5d4cab24: Deleting consensus metadata
I20260806 18:42:18.529954 2256 catalog_manager.cc:4841] TS e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): tablet 895ae123b67a45ca895e3830c3b65976 (table test-table [id=6a2014b088f4424683de6848158de11d]) successfully deleted
I20260806 18:42:18.529954 2259 catalog_manager.cc:4841] TS 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): tablet 895ae123b67a45ca895e3830c3b65976 (table test-table [id=6a2014b088f4424683de6848158de11d]) successfully deleted
W20260806 18:42:18.536958 2257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:44591 (error 108)
I20260806 18:42:18.537401 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 2570
I20260806 18:42:18.538523 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:18.538072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:44591 (local address 127.0.0.1:51460)
0806 18:42:18.538315 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:18.538397 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260806 18:42:18.538764 2257 catalog_manager.cc:4584] TS 677e814a6edc4b8cb5e7f08edfbc8163 (127.12.177.129:44591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 895ae123b67a45ca895e3830c3b65976: Network error: Client connection negotiation failed: client connection to 127.12.177.129:44591: connect: Connection refused (error 111)
I20260806 18:42:18.555908 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 2774
I20260806 18:42:18.570822 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 2228
I20260806 18:42:18.586660 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--webserver_interface=127.12.177.190
--webserver_port=38007
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:35407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:18.706753 3026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:18.707099 3026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:18.707183 3026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:18.711444 3026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:18.711555 3026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:18.711599 3026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:18.711658 3026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:18.711696 3026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:18.717471 3026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:35407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:35407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=38007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:18.718806 3026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:18.720029 3026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:18.729566 3033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.729566 3032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.729569 3035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:18.729703 3026 server_base.cc:1034] running on GCE node
I20260806 18:42:18.730599 3026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:18.731889 3026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:18.733120 3026 hybrid_clock.cc:648] HybridClock initialized: now 1786041738733097 us; error 39 us; skew 500 ppm
Aug 06 18:42:18 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:18.736521 3026 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:18.737653 3026 webserver.cc:460] Webserver started at http://127.12.177.190:38007/ using document root <none> and password file <none>
I20260806 18:42:18.738258 3026 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:18.738324 3026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:18.742592 3026 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:42:18.744946 3043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:18.746605 3026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:18.746771 3026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "16d12ced57a04dc59c82b1e63a4343af"
format_stamp: "Formatted at 2026-08-06 18:42:15 on dist-test-slave-j2vl"
server_key: "d8cf997966e1cd8c633411521686b598"
server_key_iv: "f0a49d6f83caee57b430776f9eeaae07"
server_key_version: "encryptionkey@0"
I20260806 18:42:18.747458 3026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:18.766271 3026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:18.769878 3026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:18.770097 3026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:18.777940 3026 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:35407
I20260806 18:42:18.778280 3123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:35407 every 8 connection(s)
I20260806 18:42:18.779215 3026 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:18.784030 3125 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:42:18.785142 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3026
I20260806 18:42:18.785683 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:44591
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=46563
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:18.786572 3125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap starting.
I20260806 18:42:18.813972 3125 log.cc:824] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:18.829372 3125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:18.829897 3125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: Bootstrap complete.
I20260806 18:42:18.836261 3125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:18.836807 3125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Initialized, Role: FOLLOWER
I20260806 18:42:18.837433 3125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:18.837600 3125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:18.837702 3125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:18.837834 3125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 2 FOLLOWER]: Advancing to term 3
I20260806 18:42:18.840199 3125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:18.840641 3125 leader_election.cc:302] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16d12ced57a04dc59c82b1e63a4343af; no voters:
I20260806 18:42:18.841104 3125 leader_election.cc:288] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 18:42:18.841219 3132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 3 FOLLOWER]: Leader election won for term 3
I20260806 18:42:18.841497 3132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [term 3 LEADER]: Becoming Leader. State: Replica: 16d12ced57a04dc59c82b1e63a4343af, State: Running, Role: LEADER
I20260806 18:42:18.841898 3132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } }
I20260806 18:42:18.842581 3125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:18.843613 3137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16d12ced57a04dc59c82b1e63a4343af. Latest consensus state: current_term: 3 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:18.843762 3137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:18.843631 3134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "16d12ced57a04dc59c82b1e63a4343af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d12ced57a04dc59c82b1e63a4343af" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 35407 } } }
I20260806 18:42:18.844082 3134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:18.848310 3153 catalog_manager.cc:1259] Loaded cluster ID: 58e5fc746e7449d394d636fdb26481b7
I20260806 18:42:18.848443 3153 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: loading cluster ID for follower catalog manager: success
W20260806 18:42:18.849601 3153 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 16d12ced57a04dc59c82b1e63a4343af: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260806 18:42:18.849695 3153 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260806 18:42:18.849781 3145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:18.853497 3145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:18.854081 3145 catalog_manager.cc:1259] Loaded cluster ID: 58e5fc746e7449d394d636fdb26481b7
I20260806 18:42:18.854152 3145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 18:42:18.854897 3145 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f56ed7879ad google::LogMessage::Fail() at ??:0
@ 0x7f56ed78a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f56ed7874de google::LogMessage::Flush() at ??:0
@ 0x7f56ed788a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f56f80c6fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f56f80c7d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f56f80c4579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f56f8108640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f56ef9d93d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f56ef9d9c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f56ef9db3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f56ef9ca512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f56f100e6db start_thread at ??:0
@ 0x7f56ec28561f clone at ??:0
W20260806 18:42:18.968276 3129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:18.968578 3129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:18.968629 3129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:18.973059 3129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:18.973134 3129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:18.973237 3129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:18.979187 3129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:44591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=46563
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:18.980446 3129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:18.981652 3129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:18.992290 3187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.992358 3190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:18.992535 3192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:18.992861 3129 server_base.cc:1034] running on GCE node
I20260806 18:42:18.993314 3129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:18.994093 3129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:18.995296 3129 hybrid_clock.cc:648] HybridClock initialized: now 1786041738995267 us; error 51 us; skew 500 ppm
Aug 06 18:42:18 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:18.998553 3129 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:18.999637 3129 webserver.cc:460] Webserver started at http://127.12.177.129:46563/ using document root <none> and password file <none>
I20260806 18:42:19.000269 3129 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:19.000371 3129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:19.004730 3129 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260806 18:42:19.007242 3201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.008639 3129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 18:42:19.008769 3129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "677e814a6edc4b8cb5e7f08edfbc8163"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "c2b28da1f0a676548df92b87348414f7"
server_key_iv: "95ec0df422a139131ea6e29b2deda0de"
server_key_version: "encryptionkey@0"
I20260806 18:42:19.009447 3129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:19.032015 3129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:19.036114 3129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:19.036355 3129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:19.037114 3129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:19.038540 3212 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 18:42:19.044782 3129 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 18:42:19.044930 3129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260806 18:42:19.045033 3129 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 18:42:19.047140 3129 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 18:42:19.047219 3129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 18:42:19.047601 3212 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap starting.
I20260806 18:42:19.059231 3129 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:44591
I20260806 18:42:19.060305 3129 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:19.061079 3365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:44591 every 8 connection(s)
I20260806 18:42:19.067746 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3129
I20260806 18:42:19.068251 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:33199
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=33905
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:19.072857 3212 log.cc:824] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:19.083244 3212 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:19.083765 3212 tablet_bootstrap.cc:492] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Bootstrap complete.
I20260806 18:42:19.085552 3212 ts_tablet_manager.cc:1397] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent bootstrapping tablet: real 0.038s user 0.025s sys 0.012s
I20260806 18:42:19.089183 3212 raft_consensus.cc:348] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:19.089862 3212 raft_consensus.cc:729] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677e814a6edc4b8cb5e7f08edfbc8163, State: Initialized, Role: FOLLOWER
I20260806 18:42:19.090459 3212 consensus_queue.cc:260] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:19.091615 3212 ts_tablet_manager.cc:1428] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260806 18:42:19.113158 3369 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:42:19.062623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:56851)
0806 18:42:19.063164 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.063219 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:19.064079 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:19.112189 (+ 48110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":183,"threads_started":1}
W20260806 18:42:19.113754 3367 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:35407 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:35407: Client connection negotiation failed: client connection to 127.12.177.190:35407: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 18:42:19.114626 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.114315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:44049)
0806 18:42:19.114476 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.114560 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 18:42:19.115576 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.115346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:51165)
0806 18:42:19.115456 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.115518 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 18:42:19.115876 3367 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:42:19.202443 3370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:19.202740 3370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:19.202790 3370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:19.207017 3370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:19.207095 3370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:19.207192 3370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:19.213084 3370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:33199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=33905
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:19.214473 3370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:19.215610 3370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:19.226641 3383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:19.226836 3370 server_base.cc:1034] running on GCE node
W20260806 18:42:19.226641 3379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:19.227106 3385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:19.227617 3370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:19.228307 3370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:19.229481 3370 hybrid_clock.cc:648] HybridClock initialized: now 1786041739229438 us; error 60 us; skew 500 ppm
Aug 06 18:42:19 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041739, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:19.236294 3370 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:19.237563 3370 webserver.cc:460] Webserver started at http://127.12.177.130:33905/ using document root <none> and password file <none>
I20260806 18:42:19.238245 3370 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:19.238368 3370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:19.243013 3370 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260806 18:42:19.245545 3395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.247010 3370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:42:19.247203 3370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "6a4c4cb4a6c3479a809a85f674120f42"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "f24da8fb713fa6e9e55e468c3e475bf3"
server_key_iv: "c202db6150b8724dd00cb3e1a6f7aaca"
server_key_version: "encryptionkey@0"
I20260806 18:42:19.247895 3370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:19.279588 3370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:19.282879 3370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:19.283123 3370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:19.283788 3370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:19.284715 3370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:19.284791 3370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.284866 3370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:19.284924 3370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.295382 3370 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:33199
I20260806 18:42:19.295399 3568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:33199 every 8 connection(s)
I20260806 18:42:19.296587 3370 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:19.298028 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3370
I20260806 18:42:19.298487 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:45413
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:35407
--webserver_port=37727
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:35841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:19.301393 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.299276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:46081)
0806 18:42:19.299806 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.299951 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":156,"threads_started":1}
W20260806 18:42:19.301993 3570 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:35407 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:35407: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
I20260806 18:42:19.302646 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.302410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:34275)
0806 18:42:19.302526 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.302582 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 18:42:19.303437 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.303211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:43677)
0806 18:42:19.303342 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.303388 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 18:42:19.303642 3570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:42:19.423368 3576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:19.423648 3576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:19.423698 3576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:19.428089 3576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:19.428164 3576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:19.428268 3576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:19.433997 3576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:35841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:45413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=37727
--tserver_master_addrs=127.12.177.190:35407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:19.435266 3576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:19.436456 3576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:19.446931 3587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:19.446923 3586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:19.446949 3589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:19.447130 3576 server_base.cc:1034] running on GCE node
I20260806 18:42:19.447774 3576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:19.448513 3576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:19.449678 3576 hybrid_clock.cc:648] HybridClock initialized: now 1786041739449659 us; error 33 us; skew 500 ppm
Aug 06 18:42:19 dist-test-slave-j2vl krb5kdc[1370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041739, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:19.453019 3576 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:19.454213 3576 webserver.cc:460] Webserver started at http://127.12.177.131:37727/ using document root <none> and password file <none>
I20260806 18:42:19.454870 3576 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:19.454972 3576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:19.459705 3576 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:42:19.462376 3598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.463830 3576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:19.464001 3576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "e999d773947148928d35420f5d4cab24"
format_stamp: "Formatted at 2026-08-06 18:42:16 on dist-test-slave-j2vl"
server_key: "e5db37e4189576d6049711e4fa96e343"
server_key_iv: "dc3ae842cf9d19c55fe68843a6159934"
server_key_version: "encryptionkey@0"
I20260806 18:42:19.464628 3576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:19.485213 3576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:19.488895 3576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:19.489133 3576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:19.489881 3576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:19.490804 3576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:19.490882 3576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.490959 3576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:19.491005 3576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:19.501453 3576 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:45413
I20260806 18:42:19.501472 3762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:45413 every 8 connection(s)
I20260806 18:42:19.502581 3576 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:19.506949 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.504964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:34643)
0806 18:42:19.505557 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.505689 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":140,"threads_started":1}
W20260806 18:42:19.507455 3763 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:35407 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:35407: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
I20260806 18:42:19.507848 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3576
I20260806 18:42:19.508385 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.508101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:39605)
0806 18:42:19.508256 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.508321 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 18:42:19.509086 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:19.508839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:58193)
0806 18:42:19.508955 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:19.509020 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 18:42:19.509271 3763 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 18:42:20.117151 3771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.116621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:53305)
0806 18:42:20.116922 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:20.117026 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":86,"threads_started":1}
I20260806 18:42:20.304797 3773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.304282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:34581)
0806 18:42:20.304591 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:20.304658 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":78,"threads_started":1}
I20260806 18:42:20.443635 3774 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:20.443892 3774 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:20.445261 3774 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
Aug 06 18:42:20 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.131@KRBTEST.COM
Aug 06 18:42:20 dist-test-slave-j2vl krb5kdc[1370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041738, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.130@KRBTEST.COM
I20260806 18:42:20.460593 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.445687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:44505 (local address 127.12.177.130:33199)
0806 18:42:20.446166 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:20.446199 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:20.446575 (+ 376us) server_negotiation.cc:407] Connection header received
0806 18:42:20.447372 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:20.447379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:20.447754 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:20.448098 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:20.449199 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.450245 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.451505 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.452057 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.452256 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:20.455235 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:20.455240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:20.455252 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:20.455283 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:20.457623 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:20.458347 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:20.458354 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:20.458358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:20.458524 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:20.458937 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:20.458940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:20.458941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:20.459402 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:20.459572 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:20.460142 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 18:42:20.460410 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":104,"threads_started":1}
I20260806 18:42:20.460578 3778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.446120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:33199 (local address 127.12.177.129:44505)
0806 18:42:20.446451 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:20.446463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:20.446564 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:20.448597 (+ 2033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:20.448599 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:20.448768 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:20.449011 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:20.449028 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.450426 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.450428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:20.451365 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:20.451375 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.452232 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.452236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:20.452405 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:20.453204 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:20.453217 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:20.455003 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:20.457714 (+ 2711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:20.457717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:20.457719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:20.458220 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:20.458645 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:20.458647 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:20.458649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:20.458802 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:20.459543 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:20.459550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:20.459786 (+ 236us) client_negotiation.cc:769] Sending connection context
0806 18:42:20.459985 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 18:42:20.460353 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":95,"spinlock_wait_cycles":5504,"thread_start_us":71,"threads_started":1}
I20260806 18:42:20.460592 3771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.445631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:45413 (local address 127.12.177.129:57135)
0806 18:42:20.445845 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:20.445896 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:20.446011 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:20.448160 (+ 2149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:20.448165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:20.448546 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:20.449011 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:20.449028 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.450413 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.450427 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:20.451362 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:20.451372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.452202 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.452205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:20.452408 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:20.453023 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:20.453041 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:20.454798 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:20.457654 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:20.457661 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:20.457676 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:20.458213 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:20.458898 (+ 685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:20.458904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:20.458909 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:20.459036 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:20.459685 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:20.459689 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:20.459787 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 18:42:20.459982 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 18:42:20.460439 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":229,"spinlock_wait_cycles":2816}
I20260806 18:42:20.460603 3777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.445792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:57135 (local address 127.12.177.131:45413)
0806 18:42:20.446289 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:20.446299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:20.446339 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:42:20.447272 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:20.447282 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:20.447755 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:20.448098 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:20.449207 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.450276 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.451522 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:20.452055 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:20.452248 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:20.455089 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:20.455095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:20.455108 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:20.455141 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:20.457519 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:20.458658 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:20.458662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:20.458667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:20.458787 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:20.459167 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:20.459175 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:20.459176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:20.459573 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:20.459716 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:20.460096 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 18:42:20.460396 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":84,"threads_started":1}
W20260806 18:42:20.463534 3205 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
W20260806 18:42:20.463703 3202 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:20.463761 3205 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163; no voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24
I20260806 18:42:20.464069 3774 raft_consensus.cc:2726] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:42:20.510526 3779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:20.510022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:42107)
0806 18:42:20.510335 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:20.510402 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":107,"threads_started":1}
I20260806 18:42:21.118510 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:21.118093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:54749)
0806 18:42:21.118353 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:21.118408 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":80,"threads_started":1}
I20260806 18:42:21.306324 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:21.305834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:43019)
0806 18:42:21.306138 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:21.306204 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":107,"threads_started":1}
I20260806 18:42:21.512133 3782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:21.511580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:58881)
0806 18:42:21.511919 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:21.512006 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":102,"threads_started":1}
I20260806 18:42:22.120023 3784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:22.119461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:55461)
0806 18:42:22.119836 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:22.119906 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":104,"threads_started":1}
I20260806 18:42:22.307837 3785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:22.307322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:41251)
0806 18:42:22.307632 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:22.307701 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260806 18:42:22.513698 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:22.513069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:53853)
0806 18:42:22.513518 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:22.513585 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":127,"threads_started":1}
I20260806 18:42:22.569182 3787 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:22.569320 3787 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:22.569780 3787 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
W20260806 18:42:22.570688 3202 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
W20260806 18:42:22.570856 3205 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:22.571015 3205 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163; no voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24
I20260806 18:42:22.571180 3787 raft_consensus.cc:2726] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:42:23.121613 3789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:23.121010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:41413)
0806 18:42:23.121434 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:23.121504 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260806 18:42:23.309473 3790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:23.308869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:51447)
0806 18:42:23.309192 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:23.309266 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":84,"threads_started":1}
I20260806 18:42:23.515406 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:23.514848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:40631)
0806 18:42:23.515197 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:23.515272 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":89,"threads_started":1}
I20260806 18:42:24.123366 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:24.122785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:49809)
0806 18:42:24.123168 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:24.123255 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":94,"threads_started":1}
I20260806 18:42:24.311060 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:24.310518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:34901)
0806 18:42:24.310888 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:24.310957 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":111,"threads_started":1}
I20260806 18:42:24.517094 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:24.516524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:51319)
0806 18:42:24.516831 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:24.516892 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
I20260806 18:42:24.643406 3797 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:24.643579 3797 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:24.644047 3797 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
W20260806 18:42:24.645001 3202 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
W20260806 18:42:24.645102 3205 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:24.645226 3205 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163; no voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24
I20260806 18:42:24.645453 3797 raft_consensus.cc:2726] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:42:25.124840 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:25.124344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:54291)
0806 18:42:25.124647 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:25.124712 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":113,"threads_started":1}
I20260806 18:42:25.312662 3799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:25.312158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:45805)
0806 18:42:25.312485 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:25.312557 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":104,"threads_started":1}
I20260806 18:42:25.518591 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:25.518065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:55749)
0806 18:42:25.518412 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:25.518481 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":92,"threads_started":1}
I20260806 18:42:26.126354 3802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:26.125879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:39143)
0806 18:42:26.126182 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:26.126250 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":86,"threads_started":1}
I20260806 18:42:26.314152 3803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:26.313611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:45311)
0806 18:42:26.313982 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:26.314048 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":80,"threads_started":1}
I20260806 18:42:26.520386 3804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:26.519672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:50595)
0806 18:42:26.520144 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:26.520231 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":97,"threads_started":1}
I20260806 18:42:27.128311 3805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:27.127500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:53767)
0806 18:42:27.127982 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:27.128099 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":128,"threads_started":1}
I20260806 18:42:27.316433 3806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:27.315544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:42295)
0806 18:42:27.316199 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:27.316318 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":172,"threads_started":1}
I20260806 18:42:27.522403 3807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:27.521784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:51193)
0806 18:42:27.522215 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:27.522283 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":142,"threads_started":1}
I20260806 18:42:28.130542 3809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:28.129789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:58491)
0806 18:42:28.130278 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:28.130387 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":164,"threads_started":1}
I20260806 18:42:28.319142 3811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:28.318274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:53983)
0806 18:42:28.318872 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:28.318993 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":245,"threads_started":1}
I20260806 18:42:28.524231 3813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:28.523669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:36671)
0806 18:42:28.524034 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:28.524104 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":110,"threads_started":1}
I20260806 18:42:29.132172 3814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:29.131685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:43063)
0806 18:42:29.132010 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:29.132071 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":119,"threads_started":1}
I20260806 18:42:29.320540 3815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:29.320112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:57361)
0806 18:42:29.320379 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:29.320438 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":82,"threads_started":1}
I20260806 18:42:29.369521 3816 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:29.369678 3816 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:29.370191 3816 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
W20260806 18:42:29.371241 3202 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
W20260806 18:42:29.371405 3205 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:29.371500 3205 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163; no voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24
I20260806 18:42:29.371655 3816 raft_consensus.cc:2726] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:42:29.525781 3820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:29.525256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:43343)
0806 18:42:29.525602 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:29.525668 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":136,"threads_started":1}
I20260806 18:42:30.133896 3822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:30.133299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:58459)
0806 18:42:30.133713 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:30.133786 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":107,"threads_started":1}
I20260806 18:42:30.322069 3823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:30.321613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:54879)
0806 18:42:30.321912 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:30.321977 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":117,"threads_started":1}
I20260806 18:42:30.527128 3825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:30.526643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:59593)
0806 18:42:30.526959 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:30.527022 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":86,"threads_started":1}
I20260806 18:42:30.902267 3826 raft_consensus.cc:482] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:30.902459 3826 raft_consensus.cc:504] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4c4cb4a6c3479a809a85f674120f42" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 33199 } } peers { permanent_uuid: "e999d773947148928d35420f5d4cab24" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 45413 } } peers { permanent_uuid: "677e814a6edc4b8cb5e7f08edfbc8163" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 44591 } }
I20260806 18:42:30.902976 3826 leader_election.cc:288] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199), e999d773947148928d35420f5d4cab24 (127.12.177.131:45413)
W20260806 18:42:30.903877 3205 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a4c4cb4a6c3479a809a85f674120f42 (127.12.177.130:33199): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
W20260806 18:42:30.904033 3202 leader_election.cc:341] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e999d773947148928d35420f5d4cab24 (127.12.177.131:45413): Not found: Tablet not found: 895ae123b67a45ca895e3830c3b65976
I20260806 18:42:30.904136 3202 leader_election.cc:302] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 677e814a6edc4b8cb5e7f08edfbc8163; no voters: 6a4c4cb4a6c3479a809a85f674120f42, e999d773947148928d35420f5d4cab24
I20260806 18:42:30.904330 3826 raft_consensus.cc:2726] T 895ae123b67a45ca895e3830c3b65976 P 677e814a6edc4b8cb5e7f08edfbc8163 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:42:31.135541 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:31.134976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:38859)
0806 18:42:31.135293 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:31.135365 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
I20260806 18:42:31.323417 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:31.322941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:38793)
0806 18:42:31.323249 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:31.323318 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":81,"threads_started":1}
I20260806 18:42:31.528645 3829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:31.528134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:46203)
0806 18:42:31.528469 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:31.528538 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":124,"threads_started":1}
I20260806 18:42:32.137042 3830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:32.136497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:34151)
0806 18:42:32.136869 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:32.136936 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":112,"threads_started":1}
I20260806 18:42:32.324911 3831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:32.324364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:33733)
0806 18:42:32.324704 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:32.324767 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":112,"threads_started":1}
I20260806 18:42:32.530172 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:32.529636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:42377)
0806 18:42:32.529983 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:32.530055 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":89,"threads_started":1}
I20260806 18:42:33.138489 3833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:33.137977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:35839)
0806 18:42:33.138308 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:33.138385 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":99,"threads_started":1}
I20260806 18:42:33.326422 3834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:33.325889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:45963)
0806 18:42:33.326237 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:33.326319 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":93,"threads_started":1}
I20260806 18:42:33.531705 3836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:33.531199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:56295)
0806 18:42:33.531525 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:33.531595 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":83,"threads_started":1}
I20260806 18:42:34.140244 3837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:34.139776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.129:46351)
0806 18:42:34.140067 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:34.140137 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":84,"threads_started":1}
I20260806 18:42:34.328024 3839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:34.327523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.130:42957)
0806 18:42:34.327850 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:34.327919 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":121,"threads_started":1}
I20260806 18:42:34.509513 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 3129
I20260806 18:42:34.526510 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 3370
I20260806 18:42:34.534658 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:34.533441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:35407 (local address 127.12.177.131:59277)
0806 18:42:34.534492 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:34.534553 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:35407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":592,"threads_started":1}
I20260806 18:42:34.540546 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 3576
2026-08-06T18:42:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20351 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:42:34 dist-test-slave-j2vl krb5kdc[3847](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:42:34 dist-test-slave-j2vl krb5kdc[3847](info): set up 2 sockets
Aug 06 18:42:34 dist-test-slave-j2vl krb5kdc[3847](info): commencing operation
krb5kdc: starting...
W20260806 18:42:35.851500 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:42:35 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:42:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:42:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:42:36.009830 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:36099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:36.136588 3863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:36.137012 3863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:36.137104 3863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:36.141883 3863 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 18:42:36.142004 3863 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 18:42:36.142033 3863 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 18:42:36.142055 3863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:36.142099 3863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:36.142164 3863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:36.142225 3863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:36.142263 3863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:36.148185 3863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:36099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:36.149474 3863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:36.150604 3863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:36.160969 3870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.161248 3863 server_base.cc:1034] running on GCE node
W20260806 18:42:36.161038 3875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:36.161406 3869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.162184 3863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:36.163542 3863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:36.164749 3863 hybrid_clock.cc:648] HybridClock initialized: now 1786041756164709 us; error 64 us; skew 500 ppm
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041756, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:36.168668 3863 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:36.169992 3863 webserver.cc:460] Webserver started at http://127.12.177.190:36097/ using document root <none> and password file <none>
I20260806 18:42:36.170595 3863 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:36.170665 3863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:36.170853 3863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:36.173110 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "d307f294bf9e46cbbceb7ee758a539fd"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4e7093192cd043f7376ea94908da05d3"
server_key_iv: "35c2fd4ef5c94d87c3a4612f706d54ba"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.173849 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "d307f294bf9e46cbbceb7ee758a539fd"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4e7093192cd043f7376ea94908da05d3"
server_key_iv: "35c2fd4ef5c94d87c3a4612f706d54ba"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.178138 3863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:42:36.181226 3887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.182785 3863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:36.182914 3863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d307f294bf9e46cbbceb7ee758a539fd"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4e7093192cd043f7376ea94908da05d3"
server_key_iv: "35c2fd4ef5c94d87c3a4612f706d54ba"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.183099 3863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:36.217327 3863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:36.220983 3863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:36.221212 3863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:36.228787 3863 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:36099
I20260806 18:42:36.229184 3962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:36099 every 8 connection(s)
I20260806 18:42:36.229930 3863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:36.232973 3963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:36.239616 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3863
I20260806 18:42:36.239609 3963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap starting.
I20260806 18:42:36.239791 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:42:36.240239 12998 external_mini_cluster.cc:1428] Setting key 645ab93306fa69dd1d44836322f02ff9
I20260806 18:42:36.242800 3963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:36.243692 3963 log.cc:824] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:36.246071 3963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: No bootstrap required, opened a new log
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:36.250885 3963 raft_consensus.cc:348] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:36.251250 3963 raft_consensus.cc:374] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:36.251350 3963 raft_consensus.cc:729] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Initialized, Role: FOLLOWER
I20260806 18:42:36.251924 3963 consensus_queue.cc:260] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:36.252102 3963 raft_consensus.cc:388] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:36.252197 3963 raft_consensus.cc:482] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:36.252334 3963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:36.253636 3963 raft_consensus.cc:504] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:36.254128 3963 leader_election.cc:302] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d307f294bf9e46cbbceb7ee758a539fd; no voters:
I20260806 18:42:36.254590 3963 leader_election.cc:288] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:42:36.254761 3969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:36.255046 3969 raft_consensus.cc:686] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 LEADER]: Becoming Leader. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Running, Role: LEADER
I20260806 18:42:36.255498 3969 consensus_queue.cc:237] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:36.256167 3963 sys_catalog.cc:564] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:36.257496 3970 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:42:36.257637 3970 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:36.257798 3971 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d307f294bf9e46cbbceb7ee758a539fd. Latest consensus state: current_term: 1 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:42:36.257910 3971 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:36.259065 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:36.241845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.12.177.190:36099)
0806 18:42:36.242493 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:36.242510 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:36.242553 (+ 43us) server_negotiation.cc:407] Connection header received
0806 18:42:36.243415 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:36.243440 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:36.243867 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:36.244274 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:36.245174 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.246320 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.247249 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.247813 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.248010 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:36.251333 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:36.251341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:36.251367 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:36.251418 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:36.253798 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.254572 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.254589 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.254597 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.254808 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.255234 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.255238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.255240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.255824 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:36.256040 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:36.256861 (+ 821us) server_negotiation.cc:299] Negotiation successful
0806 18:42:36.257259 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":168,"threads_started":1}
W20260806 18:42:36.262394 3990 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:42:36.262524 3990 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:42:36.262619 3981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:36.263453 3981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:36.271049 3981 catalog_manager.cc:1347] Generated new cluster ID: 009ef3d25a4a4492a50e072bd87f92b7
I20260806 18:42:36.271165 3981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:36.277886 3981 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:42:36.279353 3981 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:36.284853 3981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Generated new TSK 0
I20260806 18:42:36.285845 3981 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:42:36.330385 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:36.455892 3997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:36.456215 3997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:36.456271 3997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:36.461068 3997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:36.461164 3997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:36.461308 3997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:36.470604 3997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:36.471808 3997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:36.472833 3997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:36.484252 4009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:36.484254 4003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.484302 3997 server_base.cc:1034] running on GCE node
W20260806 18:42:36.484254 4006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.485129 3997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:36.485967 3997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:36.487211 3997 hybrid_clock.cc:648] HybridClock initialized: now 1786041756487186 us; error 32 us; skew 500 ppm
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041756, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:36.490751 3997 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:36.491904 3997 webserver.cc:460] Webserver started at http://127.12.177.129:38555/ using document root <none> and password file <none>
I20260806 18:42:36.492512 3997 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:36.492583 3997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:36.492774 3997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:36.495177 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "7edd61fdb085465caca85a5a19d6d8e2"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "9e5c0fac1d1323faa0169f11b2a94396"
server_key_iv: "71cded578e3aedfbee27e69db31acdbd"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.495810 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "7edd61fdb085465caca85a5a19d6d8e2"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "9e5c0fac1d1323faa0169f11b2a94396"
server_key_iv: "71cded578e3aedfbee27e69db31acdbd"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.500367 3997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:42:36.503419 4022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.505071 3997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:36.505461 3997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "7edd61fdb085465caca85a5a19d6d8e2"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "9e5c0fac1d1323faa0169f11b2a94396"
server_key_iv: "71cded578e3aedfbee27e69db31acdbd"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.505615 3997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:36.523459 3997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:36.527637 3997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:36.527904 3997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:36.528637 3997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:36.529732 3997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:36.529918 3997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.530153 3997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:36.530220 3997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.544173 3997 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:39399
I20260806 18:42:36.544193 4198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:39399 every 8 connection(s)
I20260806 18:42:36.545305 3997 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:36.549928 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 3997
I20260806 18:42:36.550112 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:42:36.550472 12998 external_mini_cluster.cc:1428] Setting key b4762586373909d08a3cb53b988369bc
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041756, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:42:36.564322 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:36.547885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:60939 (local address 127.12.177.190:36099)
0806 18:42:36.548060 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:36.548064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:36.549242 (+ 1178us) server_negotiation.cc:407] Connection header received
0806 18:42:36.551161 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:36.551165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:36.551234 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:36.551356 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:36.553011 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.553613 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.555250 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.555685 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.555835 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:36.559526 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:36.559530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:36.559532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:36.559564 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:36.561297 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.562216 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.562219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.562220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.562317 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.562828 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.562831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.562833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.563083 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:36.563235 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:36.564032 (+ 797us) server_negotiation.cc:299] Negotiation successful
0806 18:42:36.564173 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 18:42:36.565191 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:36.548339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:60939)
0806 18:42:36.549041 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:36.549095 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:36.550902 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:36.551578 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:36.551587 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:36.552005 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:36.552806 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:36.552832 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.553760 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.553767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:36.555061 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:36.555073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.555884 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.555888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:36.556104 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:36.556912 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:36.556966 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:36.559257 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:36.561537 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:36.561547 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:36.561586 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:36.562075 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:36.562435 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:36.562441 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:36.562445 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:36.562685 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:36.563250 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:36.563258 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:36.563646 (+ 388us) client_negotiation.cc:769] Sending connection context
0806 18:42:36.563849 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 18:42:36.564172 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":252,"threads_started":1}
I20260806 18:42:36.567067 4199 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:36.567371 4199 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:36.568007 4199 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:42:36.570739 3909 ts_manager.cc:194] Registered new tserver with Master: 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399)
I20260806 18:42:36.572000 3909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:60939
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:42:36.590340 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:36.715878 4204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:36.716207 4204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:36.716256 4204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:36.720669 4204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:36.720769 4204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:36.720835 4204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:36.727056 4204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:36.728371 4204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:36.729547 4204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:36.740175 4211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.740232 4204 server_base.cc:1034] running on GCE node
W20260806 18:42:36.740239 4214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:36.740160 4212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:36.741012 4204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:36.741791 4204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:36.743029 4204 hybrid_clock.cc:648] HybridClock initialized: now 1786041756743011 us; error 32 us; skew 500 ppm
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041756, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:36.746433 4204 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:36.747570 4204 webserver.cc:460] Webserver started at http://127.12.177.130:43571/ using document root <none> and password file <none>
I20260806 18:42:36.748159 4204 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:36.748226 4204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:36.748524 4204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:36.750914 4204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "4b282c97a2da42c98edd42887e56253b"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4b307a5368abcd9e058cd94b5477d74c"
server_key_iv: "d8a8901fa329d8e7cde21f7fd743cb73"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.751544 4204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "4b282c97a2da42c98edd42887e56253b"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4b307a5368abcd9e058cd94b5477d74c"
server_key_iv: "d8a8901fa329d8e7cde21f7fd743cb73"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.755966 4204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 18:42:36.759486 4227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.761037 4204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:36.761194 4204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "4b282c97a2da42c98edd42887e56253b"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4b307a5368abcd9e058cd94b5477d74c"
server_key_iv: "d8a8901fa329d8e7cde21f7fd743cb73"
server_key_version: "encryptionkey@0"
I20260806 18:42:36.761461 4204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:36.775183 4204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:36.778795 4204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:36.779038 4204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:36.779712 4204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:36.780653 4204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:36.780731 4204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.780827 4204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:36.780876 4204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:36.791616 4204 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44153
I20260806 18:42:36.791641 4398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44153 every 8 connection(s)
I20260806 18:42:36.793036 4204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:36.799566 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 4204
I20260806 18:42:36.799774 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:42:36.800091 12998 external_mini_cluster.cc:1428] Setting key 611a50794281e7b42fa6f3617e5dfd66
Aug 06 18:42:36 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041756, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:36.812633 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:36.795249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:51929 (local address 127.12.177.190:36099)
0806 18:42:36.795476 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:36.795480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:36.796966 (+ 1486us) server_negotiation.cc:407] Connection header received
0806 18:42:36.798502 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:36.798506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:36.798568 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:36.798657 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:36.800411 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.801098 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.802775 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.803186 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.803320 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:36.806689 (+ 3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:36.806696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:36.806702 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:36.806742 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:36.809155 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.809995 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.810003 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.810006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.810126 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:36.810695 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:36.810699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:36.810701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:36.811040 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:36.811163 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:36.811888 (+ 725us) server_negotiation.cc:299] Negotiation successful
0806 18:42:36.812301 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 18:42:36.813130 4401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:36.795699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:51929)
0806 18:42:36.796749 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:36.796802 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:36.798217 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:36.798883 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:36.798891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:36.799347 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:36.800161 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:36.800203 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.801313 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.801317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:36.802621 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:36.802634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:36.803377 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:36.803380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:36.803585 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:36.804337 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:36.804358 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:36.806456 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:36.809445 (+ 2989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:36.809453 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:36.809471 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:36.809828 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:36.810249 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:36.810252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:36.810253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:36.810572 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:36.811199 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:36.811206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:36.811564 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 18:42:36.811778 (+ 214us) client_negotiation.cc:240] Negotiation successful
0806 18:42:36.812115 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"thread_start_us":437,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:42:36.814697 4399 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:36.815011 4399 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:36.815610 4399 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
I20260806 18:42:36.816982 3909 ts_manager.cc:194] Registered new tserver with Master: 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:42:36.817749 3909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:51929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:42:36.839074 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:36.974565 4404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:36.974941 4404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:36.974993 4404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:36.981675 4404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:36.981787 4404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:36.981925 4404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:36.988621 4404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:36.989997 4404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:36.991380 4404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:37.004616 4411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:37.004674 4410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:37.004772 4414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:37.005133 4404 server_base.cc:1034] running on GCE node
I20260806 18:42:37.005752 4404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:37.006567 4404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:37.008039 4404 hybrid_clock.cc:648] HybridClock initialized: now 1786041757008018 us; error 39 us; skew 500 ppm
Aug 06 18:42:37 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041757, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:37.012161 4404 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:37.013299 4404 webserver.cc:460] Webserver started at http://127.12.177.131:43845/ using document root <none> and password file <none>
I20260806 18:42:37.013973 4404 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:37.014079 4404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:37.014331 4404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:42:37.016896 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "777c86fc18344276a6a8fcfd724436db"
format_stamp: "Formatted at 2026-08-06 18:42:37 on dist-test-slave-j2vl"
server_key: "c639bf6220c0e36a7882b95c96fa048b"
server_key_iv: "a2fc9bf0c0202048a99e00747eec010a"
server_key_version: "encryptionkey@0"
I20260806 18:42:37.017699 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "777c86fc18344276a6a8fcfd724436db"
format_stamp: "Formatted at 2026-08-06 18:42:37 on dist-test-slave-j2vl"
server_key: "c639bf6220c0e36a7882b95c96fa048b"
server_key_iv: "a2fc9bf0c0202048a99e00747eec010a"
server_key_version: "encryptionkey@0"
I20260806 18:42:37.022615 4404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 18:42:37.026177 4423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:37.027994 4404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:42:37.028237 4404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "777c86fc18344276a6a8fcfd724436db"
format_stamp: "Formatted at 2026-08-06 18:42:37 on dist-test-slave-j2vl"
server_key: "c639bf6220c0e36a7882b95c96fa048b"
server_key_iv: "a2fc9bf0c0202048a99e00747eec010a"
server_key_version: "encryptionkey@0"
I20260806 18:42:37.028446 4404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:37.052242 4404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:37.056393 4404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:37.056638 4404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:37.057646 4404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:37.058816 4404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:37.058904 4404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:37.058990 4404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:37.059034 4404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:37.069928 4404 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:32991
I20260806 18:42:37.070087 4591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:32991 every 8 connection(s)
I20260806 18:42:37.070979 4404 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:37.079015 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 4404
I20260806 18:42:37.079203 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:42:37.079557 12998 external_mini_cluster.cc:1428] Setting key ec1395480aeac94052a89376bcd02ea1
Aug 06 18:42:37 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041757, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:37.087663 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.073064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:51157 (local address 127.12.177.190:36099)
0806 18:42:37.073238 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.073242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.074209 (+ 967us) server_negotiation.cc:407] Connection header received
0806 18:42:37.075771 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.075774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.075836 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.075953 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:37.077233 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.077854 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.079607 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.079931 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.080061 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.083297 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:37.083301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:37.083303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:37.083333 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:37.085008 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:37.085814 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:37.085818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:37.085819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:37.085944 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:37.086369 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:37.086371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:37.086373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:37.086614 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:37.086694 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.087385 (+ 691us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.087524 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:42:37.088709 4595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.073499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:51157)
0806 18:42:37.074051 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.074098 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.075535 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.076140 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.076148 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.076542 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:37.077074 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.077089 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.078007 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.078010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.079431 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.079444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.080182 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.080187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.080429 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.081252 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:37.081274 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:37.083101 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:37.085168 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:37.085175 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:37.085193 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:37.085685 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:37.086085 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:37.086088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:37.086089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:37.086259 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:37.086770 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:37.086777 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:37.087122 (+ 345us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.087314 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.087626 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":129,"threads_started":1}
I20260806 18:42:37.090143 4592 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:37.090474 4592 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:37.091089 4592 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
I20260806 18:42:37.092450 3909 ts_manager.cc:194] Registered new tserver with Master: 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
I20260806 18:42:37.093262 3909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:51157
I20260806 18:42:37.094368 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:37.105252 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.096696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57902 (local address 127.12.177.190:36099)
0806 18:42:37.096846 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.096850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.097073 (+ 223us) server_negotiation.cc:407] Connection header received
0806 18:42:37.097135 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.097137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.097180 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.097266 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:37.098055 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.098623 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.099516 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.099743 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.099863 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.101812 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:37.101816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:37.101818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:37.101849 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:37.103352 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:37.103816 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:37.103819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:37.103820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:37.103906 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:37.104248 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:37.104251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:37.104252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:37.104542 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:37.104666 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.104985 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.105109 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:42:37.109618 3909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:42:37.113461 3909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:42:37.130731 4612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.124107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:32991 (local address 127.0.0.1:34858)
0806 18:42:37.125151 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.125162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.125288 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.125917 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.125920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.125940 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:37.126057 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.126063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127496 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.127499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.128546 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.128557 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.130056 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.130060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.130200 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.130260 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.130382 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.130534 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":141,"thread_start_us":94,"threads_started":1}
I20260806 18:42:37.131165 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.124557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34858 (local address 127.12.177.131:32991)
0806 18:42:37.125063 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.125082 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.125298 (+ 216us) server_negotiation.cc:407] Connection header received
0806 18:42:37.125439 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.125445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.125617 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.125757 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:37.126189 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127329 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.128688 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.129675 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.129830 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.129981 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.130883 (+ 902us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.131002 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":143,"threads_started":1}
I20260806 18:42:37.131271 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.124195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45814 (local address 127.12.177.130:44153)
0806 18:42:37.124666 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.124675 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.125088 (+ 413us) server_negotiation.cc:407] Connection header received
0806 18:42:37.125322 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.125330 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.125535 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.125701 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:37.126041 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127195 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.129447 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.130326 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.130470 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.130616 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.131004 (+ 388us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.131107 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":140,"threads_started":1}
I20260806 18:42:37.131337 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.123464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46870 (local address 127.12.177.129:39399)
0806 18:42:37.123917 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.123925 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.124339 (+ 414us) server_negotiation.cc:407] Connection header received
0806 18:42:37.125150 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.125156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.125442 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.125570 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:37.126024 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127310 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.129253 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.130149 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.130287 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.130424 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.130749 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.131171 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":117,"threads_started":1}
I20260806 18:42:37.131675 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.123723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44153 (local address 127.0.0.1:45814)
0806 18:42:37.124983 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.125000 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.125162 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.125700 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.125706 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.125729 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:37.125892 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.125901 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127343 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.127347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.129085 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.129097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.130687 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.130693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.130792 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.130848 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.131484 (+ 636us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.131570 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1150,"mutex_wait_us":178,"thread_start_us":106,"threads_started":1}
I20260806 18:42:37.132570 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.123293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:39399 (local address 127.0.0.1:46870)
0806 18:42:37.124191 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.124250 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.124921 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.125770 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.125773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.125790 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:37.125892 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.125899 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.127437 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.127440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.129085 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.129097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.130488 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.130514 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.130597 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.130620 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.130703 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.130779 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":131,"thread_start_us":139,"threads_started":1}
I20260806 18:42:37.134835 4490 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 (DEFAULT_TABLE table=test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:37.134841 4302 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 (DEFAULT_TABLE table=test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:37.135239 4095 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 (DEFAULT_TABLE table=test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:37.135871 4490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff3239669344ce78b6b6e9860d0db64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:37.135963 4302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff3239669344ce78b6b6e9860d0db64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:37.136180 4095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff3239669344ce78b6b6e9860d0db64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:37.143018 4619 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Bootstrap starting.
I20260806 18:42:37.144268 4620 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap starting.
I20260806 18:42:37.144517 4621 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Bootstrap starting.
I20260806 18:42:37.145927 4619 tablet_bootstrap.cc:654] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:37.146627 4620 tablet_bootstrap.cc:654] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:37.147156 4621 tablet_bootstrap.cc:654] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:37.147177 4619 log.cc:824] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:37.147616 4620 log.cc:824] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:37.148151 4621 log.cc:824] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:37.149498 4619 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: No bootstrap required, opened a new log
I20260806 18:42:37.149726 4619 ts_tablet_manager.cc:1397] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260806 18:42:37.150054 4621 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: No bootstrap required, opened a new log
I20260806 18:42:37.150241 4621 ts_tablet_manager.cc:1397] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 18:42:37.153321 4619 raft_consensus.cc:348] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.153765 4619 raft_consensus.cc:374] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:37.153609 4621 raft_consensus.cc:348] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.153828 4619 raft_consensus.cc:729] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777c86fc18344276a6a8fcfd724436db, State: Initialized, Role: FOLLOWER
I20260806 18:42:37.153874 4621 raft_consensus.cc:374] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:37.153928 4621 raft_consensus.cc:729] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b282c97a2da42c98edd42887e56253b, State: Initialized, Role: FOLLOWER
I20260806 18:42:37.154403 4621 consensus_queue.cc:260] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.154405 4619 consensus_queue.cc:260] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.155253 4399 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
I20260806 18:42:37.155583 4621 ts_tablet_manager.cc:1428] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 18:42:37.156041 4620 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: No bootstrap required, opened a new log
I20260806 18:42:37.156287 4620 ts_tablet_manager.cc:1397] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260806 18:42:37.157527 4619 ts_tablet_manager.cc:1428] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
I20260806 18:42:37.158257 4592 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
I20260806 18:42:37.161562 4620 raft_consensus.cc:348] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.161895 4620 raft_consensus.cc:374] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:37.161965 4620 raft_consensus.cc:729] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7edd61fdb085465caca85a5a19d6d8e2, State: Initialized, Role: FOLLOWER
I20260806 18:42:37.162454 4620 consensus_queue.cc:260] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.163214 4199 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
I20260806 18:42:37.163589 4620 ts_tablet_manager.cc:1428] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20260806 18:42:37.184623 4636 raft_consensus.cc:482] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:37.184933 4636 raft_consensus.cc:504] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.186532 4636 leader_election.cc:288] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399), 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153)
I20260806 18:42:37.190801 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.187172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:45839 (local address 127.12.177.130:44153)
0806 18:42:37.187370 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.187375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.187391 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:42:37.187481 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.187484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.187544 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.187638 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:37.187951 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.188602 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.189742 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.190177 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.190318 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.190383 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.190577 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.190664 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260806 18:42:37.190801 4595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.186888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44153 (local address 127.12.177.131:45839)
0806 18:42:37.187050 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.187070 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.187177 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.187655 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.187658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.187677 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:37.187821 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.187826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.188730 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.188735 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.189592 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.189602 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.190318 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.190322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.190444 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.190464 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.190557 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.190646 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 18:42:37.191762 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.187273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:53103 (local address 127.12.177.129:39399)
0806 18:42:37.187445 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.187451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.187671 (+ 220us) server_negotiation.cc:407] Connection header received
0806 18:42:37.187871 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.187874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.187919 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.188016 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:37.188324 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.188838 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.190026 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.190524 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.190668 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.190725 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.191546 (+ 821us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.191644 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:42:37.191807 4640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.187092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:39399 (local address 127.12.177.131:53103)
0806 18:42:37.187552 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.187566 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:37.187734 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:37.188030 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:37.188033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:37.188068 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:37.188197 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.188202 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.188965 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.188970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.189881 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:37.189891 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.190661 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.190665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:37.190782 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.190802 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 18:42:37.191524 (+ 722us) client_negotiation.cc:240] Negotiation successful
0806 18:42:37.191621 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":22,"spinlock_wait_cycles":31488,"thread_start_us":184,"threads_started":1}
I20260806 18:42:37.192268 4334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff3239669344ce78b6b6e9860d0db64" candidate_uuid: "777c86fc18344276a6a8fcfd724436db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b282c97a2da42c98edd42887e56253b" is_pre_election: true
I20260806 18:42:37.192693 4127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff3239669344ce78b6b6e9860d0db64" candidate_uuid: "777c86fc18344276a6a8fcfd724436db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7edd61fdb085465caca85a5a19d6d8e2" is_pre_election: true
I20260806 18:42:37.192910 4334 raft_consensus.cc:2454] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777c86fc18344276a6a8fcfd724436db in term 0.
I20260806 18:42:37.192970 4127 raft_consensus.cc:2454] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777c86fc18344276a6a8fcfd724436db in term 0.
I20260806 18:42:37.193670 4426 leader_election.cc:302] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777c86fc18344276a6a8fcfd724436db, 7edd61fdb085465caca85a5a19d6d8e2; no voters:
I20260806 18:42:37.194098 4636 raft_consensus.cc:2781] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:37.194218 4636 raft_consensus.cc:482] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:37.194284 4636 raft_consensus.cc:3037] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:37.195801 4636 raft_consensus.cc:504] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.196302 4636 leader_election.cc:288] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [CANDIDATE]: Term 1 election: Requested vote from peers 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399), 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153)
I20260806 18:42:37.197129 4334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff3239669344ce78b6b6e9860d0db64" candidate_uuid: "777c86fc18344276a6a8fcfd724436db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b282c97a2da42c98edd42887e56253b"
I20260806 18:42:37.197129 4127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff3239669344ce78b6b6e9860d0db64" candidate_uuid: "777c86fc18344276a6a8fcfd724436db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7edd61fdb085465caca85a5a19d6d8e2"
I20260806 18:42:37.197307 4334 raft_consensus.cc:3037] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:37.197372 4127 raft_consensus.cc:3037] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:37.198985 4334 raft_consensus.cc:2454] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777c86fc18344276a6a8fcfd724436db in term 1.
I20260806 18:42:37.198985 4127 raft_consensus.cc:2454] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777c86fc18344276a6a8fcfd724436db in term 1.
I20260806 18:42:37.199486 4426 leader_election.cc:302] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777c86fc18344276a6a8fcfd724436db, 7edd61fdb085465caca85a5a19d6d8e2; no voters:
I20260806 18:42:37.199724 4636 raft_consensus.cc:2781] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:37.200021 4636 raft_consensus.cc:686] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 1 LEADER]: Becoming Leader. State: Replica: 777c86fc18344276a6a8fcfd724436db, State: Running, Role: LEADER
I20260806 18:42:37.200392 4636 consensus_queue.cc:237] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:37.204443 3909 catalog_manager.cc:5495] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db reported cstate change: term changed from 0 to 1, leader changed from <none> to 777c86fc18344276a6a8fcfd724436db (127.12.177.131). New cstate: current_term: 1 leader_uuid: "777c86fc18344276a6a8fcfd724436db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } health_report { overall_health: UNKNOWN } } }
I20260806 18:42:37.232790 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.228334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.12.177.131:32991)
0806 18:42:37.228520 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:37.228525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:37.228564 (+ 39us) server_negotiation.cc:407] Connection header received
0806 18:42:37.228683 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:37.228686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:37.228750 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:37.228846 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:37.229177 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.229820 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.231093 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:37.231322 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:37.231413 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:37.231772 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:37.232275 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:37.232374 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:37.232466 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 18:42:37.232571 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 18:42:37.239873 4127 raft_consensus.cc:1261] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Refusing update from remote peer 777c86fc18344276a6a8fcfd724436db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:37.239867 4334 raft_consensus.cc:1261] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Refusing update from remote peer 777c86fc18344276a6a8fcfd724436db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:37.240773 4641 consensus_queue.cc:1035] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [LEADER]: Connected to new peer: Peer: permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:37.241129 4636 consensus_queue.cc:1035] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:37.249315 4647 mvcc.cc:205] Tried to move back new op lower bound from 7315627037645565952 to 7315627037496246272. Current Snapshot: MvccSnapshot[applied={T|T < 7315627037645565952}]
I20260806 18:42:37.250067 4646 mvcc.cc:205] Tried to move back new op lower bound from 7315627037645565952 to 7315627037496246272. Current Snapshot: MvccSnapshot[applied={T|T < 7315627037645565952}]
I20260806 18:42:37.260910 3909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:37.261264 3909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:37.264245 3909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Sending DeleteTablet for 3 replicas of tablet 9ff3239669344ce78b6b6e9860d0db64
I20260806 18:42:37.265367 4302 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:45814
I20260806 18:42:37.265363 4490 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:34858
I20260806 18:42:37.265419 4095 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:46870
I20260806 18:42:37.265997 4656 tablet_replica.cc:330] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: stopping tablet replica
I20260806 18:42:37.266278 4655 tablet_replica.cc:330] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: stopping tablet replica
I20260806 18:42:37.266407 4656 raft_consensus.cc:2229] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:42:37.266955 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 3997
I20260806 18:42:37.267132 4657 tablet_replica.cc:330] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: stopping tablet replica
I20260806 18:42:37.276247 4655 raft_consensus.cc:2229] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:37.276619 4656 raft_consensus.cc:2258] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:37.276971 4655 raft_consensus.cc:2258] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:37.281723 4656 ts_tablet_manager.cc:1905] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:37.282475 4655 ts_tablet_manager.cc:1905] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:37.285398 4655 ts_tablet_manager.cc:1918] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:37.285539 4655 log.cc:1196] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/9ff3239669344ce78b6b6e9860d0db64
I20260806 18:42:37.285872 4655 ts_tablet_manager.cc:1939] T 9ff3239669344ce78b6b6e9860d0db64 P 4b282c97a2da42c98edd42887e56253b: Deleting consensus metadata
I20260806 18:42:37.286002 4656 ts_tablet_manager.cc:1918] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:37.286283 4656 log.cc:1196] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/9ff3239669344ce78b6b6e9860d0db64
I20260806 18:42:37.286708 4656 ts_tablet_manager.cc:1939] T 9ff3239669344ce78b6b6e9860d0db64 P 777c86fc18344276a6a8fcfd724436db: Deleting consensus metadata
I20260806 18:42:37.287467 3893 catalog_manager.cc:4841] TS 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): tablet 9ff3239669344ce78b6b6e9860d0db64 (table test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]) successfully deleted
I20260806 18:42:37.288156 3892 catalog_manager.cc:4841] TS 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): tablet 9ff3239669344ce78b6b6e9860d0db64 (table test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]) successfully deleted
I20260806 18:42:37.289557 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 4204
W20260806 18:42:37.289523 3892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:39399 (error 108)
I20260806 18:42:37.300391 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:37.299918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:39399 (local address 127.0.0.1:46886)
0806 18:42:37.300144 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:37.300264 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260806 18:42:37.300675 3892 catalog_manager.cc:4584] TS 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9ff3239669344ce78b6b6e9860d0db64: Network error: Client connection negotiation failed: client connection to 127.12.177.129:39399: connect: Connection refused (error 111)
I20260806 18:42:37.306936 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 4404
I20260806 18:42:37.324637 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 3863
I20260806 18:42:57.340741 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--webserver_interface=127.12.177.190
--webserver_port=36097
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:36099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:42:57.466708 4659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:57.467095 4659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:57.467190 4659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:57.471573 4659 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 18:42:57.471669 4659 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 18:42:57.471698 4659 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 18:42:57.471721 4659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:42:57.471765 4659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:57.471813 4659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:57.471850 4659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:42:57.471884 4659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:42:57.477968 4659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:36099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=36097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:57.479277 4659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:57.480633 4659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:57.496423 4672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:57.496415 4671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:57.496496 4659 server_base.cc:1034] running on GCE node
W20260806 18:42:57.496415 4676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:57.497525 4659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:57.498870 4659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:57.500151 4659 hybrid_clock.cc:648] HybridClock initialized: now 1786041777500112 us; error 56 us; skew 500 ppm
Aug 06 18:42:57 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:57.503681 4659 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:42:57.504776 4659 webserver.cc:460] Webserver started at http://127.12.177.190:36097/ using document root <none> and password file <none>
I20260806 18:42:57.505497 4659 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:57.505630 4659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:57.510223 4659 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:57.512737 4686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:57.514230 4659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 18:42:57.514412 4659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d307f294bf9e46cbbceb7ee758a539fd"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4e7093192cd043f7376ea94908da05d3"
server_key_iv: "35c2fd4ef5c94d87c3a4612f706d54ba"
server_key_version: "encryptionkey@0"
I20260806 18:42:57.515123 4659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:57.528621 4659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:57.532536 4659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:57.532807 4659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:57.541230 4659 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:36099
I20260806 18:42:57.541607 4767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:36099 every 8 connection(s)
I20260806 18:42:57.542667 4659 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:42:57.547765 4768 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:42:57.549817 4768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap starting.
I20260806 18:42:57.550385 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 4659
I20260806 18:42:57.550912 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:39399
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=38555
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:57.570050 4768 log.cc:824] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:57.579795 4768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:57.580253 4768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap complete.
I20260806 18:42:57.584779 4768 raft_consensus.cc:348] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:57.585281 4768 raft_consensus.cc:729] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Initialized, Role: FOLLOWER
I20260806 18:42:57.585928 4768 consensus_queue.cc:260] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:57.586097 4768 raft_consensus.cc:388] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:42:57.586193 4768 raft_consensus.cc:482] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:42:57.586342 4768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 1 FOLLOWER]: Advancing to term 2
I20260806 18:42:57.588598 4768 raft_consensus.cc:504] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:57.589007 4768 leader_election.cc:302] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d307f294bf9e46cbbceb7ee758a539fd; no voters:
I20260806 18:42:57.589437 4768 leader_election.cc:288] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 18:42:57.589565 4775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Leader election won for term 2
I20260806 18:42:57.589769 4775 raft_consensus.cc:686] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 LEADER]: Becoming Leader. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Running, Role: LEADER
I20260806 18:42:57.590101 4775 consensus_queue.cc:237] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:42:57.590867 4768 sys_catalog.cc:564] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:42:57.591599 4777 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:42:57.591742 4777 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:57.592489 4779 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d307f294bf9e46cbbceb7ee758a539fd. Latest consensus state: current_term: 2 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:42:57.592607 4779 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:42:57.592787 4784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:42:57.598543 4784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:42:57.599606 4784 catalog_manager.cc:1259] Loaded cluster ID: 009ef3d25a4a4492a50e072bd87f92b7
I20260806 18:42:57.599689 4784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:42:57.602542 4784 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:42:57.603591 4784 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Loaded TSK: 0
I20260806 18:42:57.625655 4784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Generated new TSK 1
I20260806 18:42:57.626009 4784 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:42:57.693569 4771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:57.693856 4771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:57.693971 4771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:57.698915 4771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:57.699033 4771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:57.699133 4771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:42:57.705591 4771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:39399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=38555
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:57.706830 4771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:57.707995 4771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:57.719699 4812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:57.719817 4814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:57.720054 4816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:57.719991 4771 server_base.cc:1034] running on GCE node
I20260806 18:42:57.720520 4771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:57.721257 4771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:57.722457 4771 hybrid_clock.cc:648] HybridClock initialized: now 1786041777722424 us; error 55 us; skew 500 ppm
Aug 06 18:42:57 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:57.725988 4771 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:42:57.727140 4771 webserver.cc:460] Webserver started at http://127.12.177.129:38555/ using document root <none> and password file <none>
I20260806 18:42:57.727823 4771 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:57.727954 4771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:57.732586 4771 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:57.735275 4825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:57.736814 4771 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:42:57.736961 4771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "7edd61fdb085465caca85a5a19d6d8e2"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "9e5c0fac1d1323faa0169f11b2a94396"
server_key_iv: "71cded578e3aedfbee27e69db31acdbd"
server_key_version: "encryptionkey@0"
I20260806 18:42:57.737726 4771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:57.754616 4771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:57.758292 4771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:57.758522 4771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:57.759218 4771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:57.760493 4840 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 18:42:57.765164 4771 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 18:42:57.765290 4771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260806 18:42:57.765434 4771 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 18:42:57.767717 4771 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 18:42:57.767829 4771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 18:42:57.768375 4840 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap starting.
I20260806 18:42:57.780422 4771 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:39399
I20260806 18:42:57.780457 4992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:39399 every 8 connection(s)
I20260806 18:42:57.781663 4771 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:42:57.790570 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 4771
I20260806 18:42:57.791168 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:44153
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=43571
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:42:57.791458 4840 log.cc:824] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:42:57 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:57.802284 4996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:57.784074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:58421 (local address 127.12.177.190:36099)
0806 18:42:57.784537 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:57.784559 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:57.784957 (+ 398us) server_negotiation.cc:407] Connection header received
0806 18:42:57.786875 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:57.786888 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:57.787232 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:57.787561 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:57.789552 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.790981 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.792698 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.793316 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.793591 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:57.796738 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:57.796744 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:57.796758 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:57.796791 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:57.798809 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:57.799409 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:57.799414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:57.799418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:57.799545 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:57.799915 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:57.799919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:57.799921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:57.800292 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:57.800450 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:57.801022 (+ 572us) server_negotiation.cc:299] Negotiation successful
0806 18:42:57.801295 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":168,"threads_started":1}
I20260806 18:42:57.802309 5001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:57.784086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:58421)
0806 18:42:57.784740 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:57.784788 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:57.786347 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:57.787713 (+ 1366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:57.787724 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:57.788286 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:57.789201 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:57.789227 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.791174 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.791178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:57.792538 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:57.792551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.793542 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.793547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:57.793747 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:57.794485 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:57.794511 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:57.796488 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:57.798967 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:57.798973 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:57.798986 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:57.799262 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:57.799651 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:57.799654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:57.799656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:57.799803 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:57.800433 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:57.800439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:57.800685 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 18:42:57.800901 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 18:42:57.801272 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":183,"threads_started":1}
I20260806 18:42:57.803574 4840 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:42:57.804117 4840 tablet_bootstrap.cc:492] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap complete.
I20260806 18:42:57.804996 4993 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:57.805254 4993 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:57.805825 4993 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
I20260806 18:42:57.806039 4840 ts_tablet_manager.cc:1397] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent bootstrapping tablet: real 0.038s user 0.023s sys 0.012s
I20260806 18:42:57.808997 4713 ts_manager.cc:194] Registered new tserver with Master: 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399)
I20260806 18:42:57.809841 4840 raft_consensus.cc:348] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:57.810457 4840 raft_consensus.cc:729] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7edd61fdb085465caca85a5a19d6d8e2, State: Initialized, Role: FOLLOWER
I20260806 18:42:57.811118 4840 consensus_queue.cc:260] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } }
I20260806 18:42:57.812350 4840 ts_tablet_manager.cc:1428] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 18:42:57.813446 4713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:58421
I20260806 18:42:57.816530 4993 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
Aug 06 18:42:57 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.129@KRBTEST.COM
I20260806 18:42:57.824976 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:57.812840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.12.177.129:39399)
0806 18:42:57.813788 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:57.813801 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:57.813826 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:42:57.813903 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:57.813909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:57.814121 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:57.814267 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:57.815029 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.815881 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.816866 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.817402 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.817516 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:57.820587 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:57.820600 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:57.820614 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:57.820642 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:57.822675 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:57.823359 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:57.823364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:57.823366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:57.823462 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:57.823787 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:57.823790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:57.823791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:57.824083 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:57.824199 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:57.824646 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 18:42:57.824812 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":841,"thread_start_us":109,"threads_started":1}
I20260806 18:42:57.824966 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:57.812422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:39399 (local address 127.0.0.1:44058)
0806 18:42:57.813098 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:57.813152 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:57.813307 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:57.814273 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:57.814282 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:57.814768 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:57.814891 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:57.814898 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.816016 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.816020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:57.816725 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:57.816746 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:57.817545 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:57.817549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:57.817693 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:57.818374 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:57.818390 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:57.820358 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:57.822829 (+ 2471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:57.822843 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:57.822849 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:57.823210 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:57.823561 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:57.823565 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:57.823567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:57.823676 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:57.824207 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:57.824214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:57.824361 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 18:42:57.824517 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 18:42:57.824762 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":125,"threads_started":1}
I20260806 18:42:57.826475 4897 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff3239669344ce78b6b6e9860d0db64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:44058
I20260806 18:42:57.827463 5008 tablet_replica.cc:330] stopping tablet replica
I20260806 18:42:57.827821 5008 raft_consensus.cc:2229] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:57.828115 5008 raft_consensus.cc:2258] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:57.829550 5008 ts_tablet_manager.cc:1905] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:57.834092 5008 ts_tablet_manager.cc:1918] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:57.834251 5008 log.cc:1196] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal/wals/9ff3239669344ce78b6b6e9860d0db64
I20260806 18:42:57.834556 5008 ts_tablet_manager.cc:1939] T 9ff3239669344ce78b6b6e9860d0db64 P 7edd61fdb085465caca85a5a19d6d8e2: Deleting consensus metadata
I20260806 18:42:57.836773 4689 catalog_manager.cc:4841] TS 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399): tablet 9ff3239669344ce78b6b6e9860d0db64 (table test-table [id=f0ffceb8f0c24e44a450a3728a6bccbf]) successfully deleted
W20260806 18:42:57.932457 5003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:57.932788 5003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:57.932837 5003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:57.937192 5003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:57.937317 5003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:57.937501 5003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:42:57.943666 5003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:44153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=43571
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:57.944996 5003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:57.946214 5003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:57.957319 5016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:57.957439 5003 server_base.cc:1034] running on GCE node
W20260806 18:42:57.957319 5015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:57.957368 5020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:57.958178 5003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:57.959007 5003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:57.960228 5003 hybrid_clock.cc:648] HybridClock initialized: now 1786041777960215 us; error 29 us; skew 500 ppm
Aug 06 18:42:57 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:57.963519 5003 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:42:57.964625 5003 webserver.cc:460] Webserver started at http://127.12.177.130:43571/ using document root <none> and password file <none>
I20260806 18:42:57.965276 5003 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:57.965430 5003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:57.969915 5003 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:57.972776 5034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:57.974756 5003 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:42:57.974951 5003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "4b282c97a2da42c98edd42887e56253b"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4b307a5368abcd9e058cd94b5477d74c"
server_key_iv: "d8a8901fa329d8e7cde21f7fd743cb73"
server_key_version: "encryptionkey@0"
I20260806 18:42:57.975656 5003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:58.012560 5003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:58.016564 5003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:58.016822 5003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:58.017876 5003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:58.018946 5003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:58.019024 5003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:58.019105 5003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:58.019155 5003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:58.030718 5003 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44153
I20260806 18:42:58.030916 5209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44153 every 8 connection(s)
I20260806 18:42:58.031975 5003 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:42:58.032717 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 5003
I20260806 18:42:58.033278 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:32991
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=43845
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 18:42:58 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:58.055099 4996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.034447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:45655 (local address 127.12.177.190:36099)
0806 18:42:58.034647 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.034655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.036048 (+ 1393us) server_negotiation.cc:407] Connection header received
0806 18:42:58.038428 (+ 2380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.038431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.038506 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.038603 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:58.041245 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.041931 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.044182 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.044477 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.044586 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.049334 (+ 4748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:58.049338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:58.049419 (+ 81us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:58.049466 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:58.051882 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.052795 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.052799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.052801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.052914 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.053580 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.053583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.053585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.053830 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:58.053944 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.054780 (+ 836us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.054956 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:42:58.056346 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.034926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:45655)
0806 18:42:58.035811 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.035887 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.038058 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.038880 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.038894 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.039784 (+ 890us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:58.040928 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.040965 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.042132 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.042139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.043974 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.043994 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.044704 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.044711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.045001 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.045837 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:58.045870 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:58.048814 (+ 2944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:58.052080 (+ 3266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:58.052090 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:58.052115 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:58.052615 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:58.053036 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:58.053039 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:58.053041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:58.053287 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:58.053989 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:58.053999 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:58.054417 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.054675 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.055129 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":167,"threads_started":1}
I20260806 18:42:58.058166 5210 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:58.058503 5210 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:58.059155 5210 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
I20260806 18:42:58.060686 4713 ts_manager.cc:194] Registered new tserver with Master: 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153)
I20260806 18:42:58.061658 4713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:45655
W20260806 18:42:58.178596 5212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:42:58.178941 5212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:42:58.178992 5212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:42:58.183670 5212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:42:58.183756 5212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:42:58.183830 5212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:42:58.189819 5212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:32991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=43845
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:42:58.191466 5212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:42:58.192795 5212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:42:58.205470 5223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:42:58.205421 5219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:58.205650 5212 server_base.cc:1034] running on GCE node
W20260806 18:42:58.205715 5220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:42:58.206367 5212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:42:58.207106 5212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:42:58.208292 5212 hybrid_clock.cc:648] HybridClock initialized: now 1786041778208249 us; error 58 us; skew 500 ppm
Aug 06 18:42:58 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041778, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:42:58.211601 5212 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:42:58.212764 5212 webserver.cc:460] Webserver started at http://127.12.177.131:43845/ using document root <none> and password file <none>
I20260806 18:42:58.213505 5212 fs_manager.cc:359] Metadata directory not provided
I20260806 18:42:58.213618 5212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:42:58.218148 5212 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:58.220919 5233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:58.222645 5212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:42:58.222829 5212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "777c86fc18344276a6a8fcfd724436db"
format_stamp: "Formatted at 2026-08-06 18:42:37 on dist-test-slave-j2vl"
server_key: "c639bf6220c0e36a7882b95c96fa048b"
server_key_iv: "a2fc9bf0c0202048a99e00747eec010a"
server_key_version: "encryptionkey@0"
I20260806 18:42:58.223515 5212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:42:58.248667 5212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:42:58.252678 5212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:42:58.252941 5212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:42:58.253677 5212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:42:58.254647 5212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:42:58.254747 5212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:58.254846 5212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:42:58.254899 5212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:42:58.265195 5212 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:32991
I20260806 18:42:58.265223 5412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:32991 every 8 connection(s)
I20260806 18:42:58.266388 5212 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:42:58.275019 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 5212
Aug 06 18:42:58 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041778, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:42:58.282549 4996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.268385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59423 (local address 127.12.177.190:36099)
0806 18:42:58.268573 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.268577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.269595 (+ 1018us) server_negotiation.cc:407] Connection header received
0806 18:42:58.271089 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.271092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.271158 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.271272 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:58.272595 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.273151 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.274413 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.274733 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.274871 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.278149 (+ 3278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:58.278152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:58.278155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:58.278181 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:58.279948 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.280557 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.280565 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.280567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.280699 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.281107 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.281110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.281112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.281303 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:58.281453 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.282122 (+ 669us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.282323 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 18:42:58.283460 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.268815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:59423)
0806 18:42:58.269405 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.269480 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.270818 (+ 1338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.271485 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.271493 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.271902 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:42:58.272427 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.272442 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.273306 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.273314 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.274262 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.274283 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.274945 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.274949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.275183 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.275902 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:42:58.275921 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:42:58.277945 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:42:58.280097 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:58.280107 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:58.280127 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:58.280434 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:58.280817 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:42:58.280822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:42:58.280824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:42:58.280995 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:42:58.281455 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:42:58.281463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:42:58.281750 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.281988 (+ 238us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.282334 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":125,"threads_started":1}
I20260806 18:42:58.284914 5413 heartbeater.cc:347] Connected to a master server at 127.12.177.190:36099
I20260806 18:42:58.285236 5413 heartbeater.cc:464] Registering TS with master...
I20260806 18:42:58.285882 5418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.275895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54318 (local address 127.12.177.190:36099)
0806 18:42:58.276189 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.276192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.276314 (+ 122us) server_negotiation.cc:407] Connection header received
0806 18:42:58.276448 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.276450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.276498 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.276579 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:58.277525 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.278258 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.279622 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.279885 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.279973 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.281568 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:58.281573 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:58.281580 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:58.281604 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:58.283449 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.284031 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.284036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.284038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.284135 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.284613 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.284615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.284616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.284803 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:58.285078 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.285282 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.285446 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":96,"threads_started":1}
I20260806 18:42:58.285956 5413 heartbeater.cc:511] Master 127.12.177.190:36099 requested a full tablet report, sending...
I20260806 18:42:58.287175 4713 ts_manager.cc:194] Registered new tserver with Master: 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
I20260806 18:42:58.287776 4713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:59423
I20260806 18:42:58.287941 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:42:58.292426 5418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.288625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54330 (local address 127.12.177.190:36099)
0806 18:42:58.288764 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.288769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.288987 (+ 218us) server_negotiation.cc:407] Connection header received
0806 18:42:58.289137 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.289139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.289237 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.289320 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:58.289635 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.290194 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.291126 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.291373 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.291479 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.291790 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:58.291963 (+ 173us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 18:42:58.292244 (+ 281us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54330: token expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 18:42:58.292517 5418 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54330: token expired
W20260806 18:42:58.293013 4603 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.177.190:36099)
I20260806 18:42:58.301045 5418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.293477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.12.177.190:36099)
0806 18:42:58.293619 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.293622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.293634 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:42:58.293720 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.293722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.293760 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.293825 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:42:58.294447 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.295076 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.295854 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.296088 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.296174 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.297620 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:42:58.297623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:42:58.297625 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:42:58.297650 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:42:58.299281 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.299733 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.299736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.299737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.299822 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:42:58.300151 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:42:58.300154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:42:58.300155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:42:58.300357 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:42:58.300465 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.300712 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.300831 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:42:58.303998 4713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:42:58.307673 4713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:42:58.317164 4897 tablet_service.cc:1467] Processing CreateTablet for tablet 6840fabe6b9d48deabfe80c99dc9f2f4 (DEFAULT_TABLE table=test-table [id=046bd685201e40bfa2e580b9aa1eec55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:58.318011 4897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6840fabe6b9d48deabfe80c99dc9f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:58.321987 5429 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap starting.
I20260806 18:42:58.322319 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.316001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:32991 (local address 127.0.0.1:59222)
0806 18:42:58.316337 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.316354 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.316449 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.317212 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.317215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.317235 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:58.317397 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.317405 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.318906 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.318912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.320327 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.320341 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.321683 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.321687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.321893 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.321975 (+ 82us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.322047 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.322148 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":1,"thread_start_us":134,"threads_started":1}
I20260806 18:42:58.322606 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.315742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44153 (local address 127.0.0.1:50084)
0806 18:42:58.315884 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.315904 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.316018 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.317234 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.317237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.317257 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:58.317407 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.317415 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.319236 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.319239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.320452 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.320462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.321932 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.321943 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.322247 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.322279 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.322349 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.322463 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":26}
I20260806 18:42:58.323105 5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.316268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.12.177.131:32991)
0806 18:42:58.316741 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.316751 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.316772 (+ 21us) server_negotiation.cc:407] Connection header received
0806 18:42:58.316846 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.316850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.317043 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.317241 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:58.317546 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.318779 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.320494 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.321516 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.322555 (+ 1039us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.322745 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.322813 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.322927 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":146,"threads_started":1}
I20260806 18:42:58.323187 5429 tablet_bootstrap.cc:654] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:58.323972 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.316185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.12.177.130:44153)
0806 18:42:58.316726 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.316747 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.316773 (+ 26us) server_negotiation.cc:407] Connection header received
0806 18:42:58.316856 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.316861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.317056 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.317573 (+ 517us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:58.317770 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.319099 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.320609 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.321659 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.323490 (+ 1831us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.323613 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.323663 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.323746 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":179,"threads_started":1}
I20260806 18:42:58.327059 5315 tablet_service.cc:1467] Processing CreateTablet for tablet 6840fabe6b9d48deabfe80c99dc9f2f4 (DEFAULT_TABLE table=test-table [id=046bd685201e40bfa2e580b9aa1eec55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:58.327059 5106 tablet_service.cc:1467] Processing CreateTablet for tablet 6840fabe6b9d48deabfe80c99dc9f2f4 (DEFAULT_TABLE table=test-table [id=046bd685201e40bfa2e580b9aa1eec55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:42:58.328469 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6840fabe6b9d48deabfe80c99dc9f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:58.328464 5106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6840fabe6b9d48deabfe80c99dc9f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:42:58.330379 5429 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: No bootstrap required, opened a new log
I20260806 18:42:58.330624 5429 ts_tablet_manager.cc:1397] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260806 18:42:58.331241 5429 raft_consensus.cc:348] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.331434 5429 raft_consensus.cc:374] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:58.331490 5429 raft_consensus.cc:729] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7edd61fdb085465caca85a5a19d6d8e2, State: Initialized, Role: FOLLOWER
I20260806 18:42:58.331686 5429 consensus_queue.cc:260] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.332131 5429 ts_tablet_manager.cc:1428] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 18:42:58.338670 5434 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Bootstrap starting.
I20260806 18:42:58.339489 5433 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Bootstrap starting.
I20260806 18:42:58.342024 5433 tablet_bootstrap.cc:654] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:58.342218 5434 tablet_bootstrap.cc:654] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Neither blocks nor log segments found. Creating new log.
I20260806 18:42:58.343391 5434 log.cc:824] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:58.343391 5433 log.cc:824] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Log is configured to *not* fsync() on all Append() calls
I20260806 18:42:58.345811 5434 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: No bootstrap required, opened a new log
I20260806 18:42:58.346016 5434 ts_tablet_manager.cc:1397] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 18:42:58.346138 5433 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: No bootstrap required, opened a new log
I20260806 18:42:58.346369 5433 ts_tablet_manager.cc:1397] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 18:42:58.349711 5434 raft_consensus.cc:348] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.350099 5434 raft_consensus.cc:374] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:58.350172 5434 raft_consensus.cc:729] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b282c97a2da42c98edd42887e56253b, State: Initialized, Role: FOLLOWER
I20260806 18:42:58.351060 5433 raft_consensus.cc:348] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.351406 5433 raft_consensus.cc:374] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:42:58.351215 5434 consensus_queue.cc:260] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.351498 5433 raft_consensus.cc:729] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777c86fc18344276a6a8fcfd724436db, State: Initialized, Role: FOLLOWER
I20260806 18:42:58.351956 5433 consensus_queue.cc:260] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.352843 5413 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
I20260806 18:42:58.353097 5433 ts_tablet_manager.cc:1428] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:42:58.353101 5434 ts_tablet_manager.cc:1428] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:42:58.353555 5210 heartbeater.cc:503] Master 127.12.177.190:36099 was elected leader, sending a full tablet report...
I20260806 18:42:58.413475 5432 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:42:58.413712 5432 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.414893 5432 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
I20260806 18:42:58.419754 5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.415499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:56727 (local address 127.12.177.131:32991)
0806 18:42:58.415631 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.415637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.415815 (+ 178us) server_negotiation.cc:407] Connection header received
0806 18:42:58.415983 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.415988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.416045 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.416130 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:58.416453 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.417050 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.418453 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.419069 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.419203 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.419260 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.419509 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.419606 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 18:42:58.419852 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.415408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:38733 (local address 127.12.177.130:44153)
0806 18:42:58.415570 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.415575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.416017 (+ 442us) server_negotiation.cc:407] Connection header received
0806 18:42:58.416171 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.416174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.416230 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.416313 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:42:58.416619 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.417281 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.418462 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.419068 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.419190 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.419260 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.419617 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.419712 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:42:58.419804 5445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.415248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:32991 (local address 127.12.177.129:56727)
0806 18:42:58.415712 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.415726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.415847 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.416166 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.416168 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.416189 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:58.416331 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.416338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.417280 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.417283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.418308 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.418320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.419200 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.419204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.419315 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.419381 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.419489 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.419580 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":27,"thread_start_us":124,"threads_started":1}
I20260806 18:42:58.420332 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.415248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44153 (local address 127.12.177.129:38733)
0806 18:42:58.415885 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.415897 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:42:58.416033 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:42:58.416339 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:42:58.416341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:42:58.416357 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:42:58.416486 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.416493 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.417432 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.417435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.418312 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:42:58.418327 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.419341 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.419345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:42:58.419443 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.419480 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 18:42:58.420056 (+ 576us) client_negotiation.cc:240] Negotiation successful
0806 18:42:58.420148 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":172,"thread_start_us":58,"threads_started":1}
I20260806 18:42:58.420893 5344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6840fabe6b9d48deabfe80c99dc9f2f4" candidate_uuid: "7edd61fdb085465caca85a5a19d6d8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777c86fc18344276a6a8fcfd724436db" is_pre_election: true
I20260806 18:42:58.421335 5138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6840fabe6b9d48deabfe80c99dc9f2f4" candidate_uuid: "7edd61fdb085465caca85a5a19d6d8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b282c97a2da42c98edd42887e56253b" is_pre_election: true
I20260806 18:42:58.421530 5344 raft_consensus.cc:2454] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7edd61fdb085465caca85a5a19d6d8e2 in term 0.
I20260806 18:42:58.421725 5138 raft_consensus.cc:2454] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7edd61fdb085465caca85a5a19d6d8e2 in term 0.
I20260806 18:42:58.422392 4832 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db, 7edd61fdb085465caca85a5a19d6d8e2; no voters:
I20260806 18:42:58.422712 5432 raft_consensus.cc:2781] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:42:58.422827 5432 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:42:58.422892 5432 raft_consensus.cc:3037] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:58.424070 5432 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.424484 5432 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 1 election: Requested vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
I20260806 18:42:58.425009 5138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6840fabe6b9d48deabfe80c99dc9f2f4" candidate_uuid: "7edd61fdb085465caca85a5a19d6d8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b282c97a2da42c98edd42887e56253b"
I20260806 18:42:58.425165 5138 raft_consensus.cc:3037] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:58.425221 5344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6840fabe6b9d48deabfe80c99dc9f2f4" candidate_uuid: "7edd61fdb085465caca85a5a19d6d8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777c86fc18344276a6a8fcfd724436db"
I20260806 18:42:58.425451 5344 raft_consensus.cc:3037] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:42:58.426486 5138 raft_consensus.cc:2454] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7edd61fdb085465caca85a5a19d6d8e2 in term 1.
I20260806 18:42:58.426615 5344 raft_consensus.cc:2454] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7edd61fdb085465caca85a5a19d6d8e2 in term 1.
I20260806 18:42:58.426929 4833 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b282c97a2da42c98edd42887e56253b, 7edd61fdb085465caca85a5a19d6d8e2; no voters:
I20260806 18:42:58.427173 5432 raft_consensus.cc:2781] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:42:58.427474 5432 raft_consensus.cc:686] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 LEADER]: Becoming Leader. State: Replica: 7edd61fdb085465caca85a5a19d6d8e2, State: Running, Role: LEADER
I20260806 18:42:58.427799 5432 consensus_queue.cc:237] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:42:58.431768 4709 catalog_manager.cc:5495] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129). New cstate: current_term: 1 leader_uuid: "7edd61fdb085465caca85a5a19d6d8e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } health_report { overall_health: HEALTHY } } }
I20260806 18:42:58.454528 5454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.450026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.12.177.129:39399)
0806 18:42:58.450395 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0806 18:42:58.450403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:42:58.450418 (+ 15us) server_negotiation.cc:407] Connection header received
0806 18:42:58.450598 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:42:58.450603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:42:58.450686 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:42:58.450898 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:42:58.451189 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.451744 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.452605 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:42:58.452841 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:42:58.452957 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:42:58.453267 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:42:58.453836 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:42:58.453973 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:42:58.454038 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 18:42:58.454108 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":145,"threads_started":1}
I20260806 18:42:58.459776 5138 raft_consensus.cc:1261] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Refusing update from remote peer 7edd61fdb085465caca85a5a19d6d8e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:58.459776 5344 raft_consensus.cc:1261] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Refusing update from remote peer 7edd61fdb085465caca85a5a19d6d8e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:42:58.460712 5432 consensus_queue.cc:1035] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:58.461025 5448 consensus_queue.cc:1035] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:42:58.474064 5457 mvcc.cc:205] Tried to move back new op lower bound from 7315627124561956864 to 7315627124444319744. Current Snapshot: MvccSnapshot[applied={T|T < 7315627124561956864}]
I20260806 18:42:58.482627 4713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:58.482821 4713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:42:58.485803 4713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Sending DeleteTablet for 3 replicas of tablet 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:42:58.486830 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 4771
I20260806 18:42:58.486881 5315 tablet_service.cc:1514] Processing DeleteTablet for tablet 6840fabe6b9d48deabfe80c99dc9f2f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:58 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:59222
I20260806 18:42:58.487532 5106 tablet_service.cc:1514] Processing DeleteTablet for tablet 6840fabe6b9d48deabfe80c99dc9f2f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:42:58 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:50084
I20260806 18:42:58.498095 5472 tablet_replica.cc:330] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: stopping tablet replica
I20260806 18:42:58.498718 5472 raft_consensus.cc:2229] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:58.499115 5472 raft_consensus.cc:2258] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:58.500008 5470 tablet_replica.cc:330] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: stopping tablet replica
I20260806 18:42:58.500403 5470 raft_consensus.cc:2229] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:42:58.500763 5470 raft_consensus.cc:2258] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:42:58.502511 5470 ts_tablet_manager.cc:1905] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:58.503057 5472 ts_tablet_manager.cc:1905] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:42:58.504963 5470 ts_tablet_manager.cc:1918] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:58.505069 5470 log.cc:1196] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:42:58.505431 5470 ts_tablet_manager.cc:1939] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 777c86fc18344276a6a8fcfd724436db: Deleting consensus metadata
I20260806 18:42:58.506860 4689 catalog_manager.cc:4841] TS 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): tablet 6840fabe6b9d48deabfe80c99dc9f2f4 (table test-table [id=046bd685201e40bfa2e580b9aa1eec55]) successfully deleted
I20260806 18:42:58.507306 5472 ts_tablet_manager.cc:1918] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:42:58.507455 5472 log.cc:1196] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:42:58.507881 5472 ts_tablet_manager.cc:1939] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 4b282c97a2da42c98edd42887e56253b: Deleting consensus metadata
W20260806 18:42:58.508745 4689 connection.cc:535] client connection to 127.12.177.129:39399 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 18:42:58.508956 4689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 18:42:58.509464 4690 catalog_manager.cc:4841] TS 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): tablet 6840fabe6b9d48deabfe80c99dc9f2f4 (table test-table [id=046bd685201e40bfa2e580b9aa1eec55]) successfully deleted
I20260806 18:42:58.509908 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 5003
I20260806 18:42:58.510368 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:42:58.509959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:39399 (local address 127.0.0.1:44074)
0806 18:42:58.510189 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 18:42:58.510266 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260806 18:42:58.523239 4689 catalog_manager.cc:4584] TS 7edd61fdb085465caca85a5a19d6d8e2 (127.12.177.129:39399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6840fabe6b9d48deabfe80c99dc9f2f4: Network error: Client connection negotiation failed: client connection to 127.12.177.129:39399: connect: Connection refused (error 111)
I20260806 18:42:58.529827 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 5212
I20260806 18:42:58.546115 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 4659
I20260806 18:43:18.561165 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--webserver_interface=127.12.177.190
--webserver_port=36097
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:36099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:18.688201 5475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:18.688567 5475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:18.688614 5475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:18.693689 5475 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 18:43:18.693794 5475 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 18:43:18.693813 5475 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 18:43:18.693828 5475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:18.693848 5475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:18.693868 5475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:18.693892 5475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:18.693979 5475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:18.700497 5475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:36099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:36099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=36097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:18.701860 5475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:18.703019 5475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:18.713653 5487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:18.713658 5484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:18.713658 5483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:18.713841 5475 server_base.cc:1034] running on GCE node
I20260806 18:43:18.714867 5475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:18.716344 5475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:18.717561 5475 hybrid_clock.cc:648] HybridClock initialized: now 1786041798717533 us; error 44 us; skew 500 ppm
Aug 06 18:43:18 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041798, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:18.720820 5475 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:43:18.721941 5475 webserver.cc:460] Webserver started at http://127.12.177.190:36097/ using document root <none> and password file <none>
I20260806 18:43:18.722635 5475 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:18.722746 5475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:18.727240 5475 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:43:18.729952 5498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:18.731422 5475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:18.731617 5475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d307f294bf9e46cbbceb7ee758a539fd"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4e7093192cd043f7376ea94908da05d3"
server_key_iv: "35c2fd4ef5c94d87c3a4612f706d54ba"
server_key_version: "encryptionkey@0"
I20260806 18:43:18.732293 5475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:18.753747 5475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:18.757393 5475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:18.757664 5475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:18.766578 5475 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:36099
I20260806 18:43:18.767045 5575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:36099 every 8 connection(s)
I20260806 18:43:18.767889 5475 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:18.770795 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 5475
I20260806 18:43:18.771311 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:39399
--local_ip_for_outbound_sockets=127.12.177.129
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=38555
--webserver_interface=127.12.177.129
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:43:18.773195 5577 sys_catalog.cc:263] Verifying existing consensus state
I20260806 18:43:18.775234 5577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap starting.
I20260806 18:43:18.794979 5577 log.cc:824] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:18.807685 5577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:43:18.808228 5577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Bootstrap complete.
I20260806 18:43:18.813328 5577 raft_consensus.cc:348] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:43:18.813989 5577 raft_consensus.cc:729] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Initialized, Role: FOLLOWER
I20260806 18:43:18.814564 5577 consensus_queue.cc:260] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:43:18.814774 5577 raft_consensus.cc:388] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:18.814872 5577 raft_consensus.cc:482] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:18.815018 5577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 2 FOLLOWER]: Advancing to term 3
I20260806 18:43:18.817306 5577 raft_consensus.cc:504] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:43:18.817747 5577 leader_election.cc:302] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d307f294bf9e46cbbceb7ee758a539fd; no voters:
I20260806 18:43:18.818187 5577 leader_election.cc:288] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 18:43:18.818272 5581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 3 FOLLOWER]: Leader election won for term 3
I20260806 18:43:18.818554 5581 raft_consensus.cc:686] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [term 3 LEADER]: Becoming Leader. State: Replica: d307f294bf9e46cbbceb7ee758a539fd, State: Running, Role: LEADER
I20260806 18:43:18.818940 5581 consensus_queue.cc:237] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } }
I20260806 18:43:18.819595 5577 sys_catalog.cc:564] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:18.820417 5582 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:43:18.820551 5582 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:18.820974 5583 sys_catalog.cc:455] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d307f294bf9e46cbbceb7ee758a539fd. Latest consensus state: current_term: 3 leader_uuid: "d307f294bf9e46cbbceb7ee758a539fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d307f294bf9e46cbbceb7ee758a539fd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 36099 } } }
I20260806 18:43:18.821123 5583 sys_catalog.cc:458] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:18.821635 5595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:18.827464 5595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:18.828141 5595 catalog_manager.cc:1259] Loaded cluster ID: 009ef3d25a4a4492a50e072bd87f92b7
I20260806 18:43:18.828210 5595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:18.831306 5595 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:18.832111 5595 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Loaded TSK: 0
I20260806 18:43:18.832204 5595 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d307f294bf9e46cbbceb7ee758a539fd: Loaded TSK: 1
F20260806 18:43:18.832978 5595 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f00b02689ad google::LogMessage::Fail() at ??:0
@ 0x7f00b026b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f00b02684de google::LogMessage::Flush() at ??:0
@ 0x7f00b0269a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f00b2f2c18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f00b2f24f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f00babcd7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f00baba799c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f00baba8178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f00babe9df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f00bac0882b std::function<>::operator()() at ??:0
@ 0x7f00baba7b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f00baba8f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f00baba5579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f00babe9640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f00b24ba3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f00b24bac83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f00b24bc3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f00b24ab512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f00b3aef6db start_thread at ??:0
@ 0x7f00aed6661f clone at ??:0
W20260806 18:43:18.930716 5579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:18.931015 5579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:18.931063 5579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:18.936131 5579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:18.936204 5579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:18.936275 5579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:18.944645 5579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:39399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=38555
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:18.946053 5579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:18.947180 5579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:18.958108 5650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:18.958094 5647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:18.958094 5646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:18.958647 5579 server_base.cc:1034] running on GCE node
I20260806 18:43:18.959147 5579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:18.960031 5579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:18.961244 5579 hybrid_clock.cc:648] HybridClock initialized: now 1786041798961214 us; error 48 us; skew 500 ppm
Aug 06 18:43:18 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041798, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:18.964421 5579 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:43:18.965761 5579 webserver.cc:460] Webserver started at http://127.12.177.129:38555/ using document root <none> and password file <none>
I20260806 18:43:18.966427 5579 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:18.966498 5579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:18.972347 5579 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 18:43:18.975440 5659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:18.977254 5579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:43:18.977509 5579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "7edd61fdb085465caca85a5a19d6d8e2"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "9e5c0fac1d1323faa0169f11b2a94396"
server_key_iv: "71cded578e3aedfbee27e69db31acdbd"
server_key_version: "encryptionkey@0"
I20260806 18:43:18.978415 5579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:18.995085 5579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:18.999053 5579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:18.999315 5579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:19.000028 5579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:19.001381 5668 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 18:43:19.007548 5579 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 18:43:19.007682 5579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260806 18:43:19.007786 5579 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 18:43:19.009713 5579 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 18:43:19.009796 5579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.002s
I20260806 18:43:19.010111 5668 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap starting.
I20260806 18:43:19.021385 5579 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:39399
I20260806 18:43:19.021751 5821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:39399 every 8 connection(s)
I20260806 18:43:19.022554 5579 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:19.031554 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 5579
I20260806 18:43:19.032087 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:44153
--local_ip_for_outbound_sockets=127.12.177.130
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=43571
--webserver_interface=127.12.177.130
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:43:19.034466 5668 log.cc:824] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:19.045743 5668 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 18:43:19.046276 5668 tablet_bootstrap.cc:492] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Bootstrap complete.
I20260806 18:43:19.048029 5668 ts_tablet_manager.cc:1397] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent bootstrapping tablet: real 0.038s user 0.023s sys 0.012s
I20260806 18:43:19.051496 5668 raft_consensus.cc:348] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:19.052083 5668 raft_consensus.cc:729] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7edd61fdb085465caca85a5a19d6d8e2, State: Initialized, Role: FOLLOWER
I20260806 18:43:19.052623 5668 consensus_queue.cc:260] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:19.053752 5668 ts_tablet_manager.cc:1428] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260806 18:43:19.116788 5826 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:43:19.024691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:46299)
0806 18:43:19.025234 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.025290 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:19.026183 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:19.115618 (+ 89435us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":181,"threads_started":1}
W20260806 18:43:19.117512 5823 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:36099 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:36099: Client connection negotiation failed: client connection to 127.12.177.190:36099: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 18:43:19.118414 5826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.118095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:53221)
0806 18:43:19.118256 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.118341 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 18:43:19.119210 5826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.118923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:40767)
0806 18:43:19.119070 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.119136 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 18:43:19.119463 5823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:43:19.167066 5827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:19.167382 5827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:19.167433 5827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:19.171995 5827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:19.172076 5827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:19.172144 5827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:19.178179 5827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:44153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=43571
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:19.179452 5827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:19.180620 5827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:19.191298 5837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:19.191285 5838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:19.191285 5842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:19.191532 5827 server_base.cc:1034] running on GCE node
I20260806 18:43:19.192094 5827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:19.192807 5827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:19.194046 5827 hybrid_clock.cc:648] HybridClock initialized: now 1786041799194030 us; error 33 us; skew 500 ppm
Aug 06 18:43:19 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041799, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:19.197439 5827 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:43:19.198422 5827 webserver.cc:460] Webserver started at http://127.12.177.130:43571/ using document root <none> and password file <none>
I20260806 18:43:19.199036 5827 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:19.199139 5827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:19.203395 5827 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:43:19.205789 5853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.207144 5827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:19.207302 5827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "4b282c97a2da42c98edd42887e56253b"
format_stamp: "Formatted at 2026-08-06 18:42:36 on dist-test-slave-j2vl"
server_key: "4b307a5368abcd9e058cd94b5477d74c"
server_key_iv: "d8a8901fa329d8e7cde21f7fd743cb73"
server_key_version: "encryptionkey@0"
I20260806 18:43:19.207942 5827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:19.233573 5827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:19.237530 5827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:19.237807 5827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:19.238551 5827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:19.239531 5827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:19.239614 5827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.239689 5827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:19.239745 5827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.249820 5827 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:44153
I20260806 18:43:19.249840 6015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:44153 every 8 connection(s)
I20260806 18:43:19.250977 5827 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:19.252411 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 5827
I20260806 18:43:19.252876 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:32991
--local_ip_for_outbound_sockets=127.12.177.131
--tserver_master_addrs=127.12.177.190:36099
--webserver_port=43845
--webserver_interface=127.12.177.131
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:43:19.255568 6018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.253532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:58361)
0806 18:43:19.254105 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.254244 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":160,"threads_started":1}
W20260806 18:43:19.256243 6016 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:36099 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:36099: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
I20260806 18:43:19.257051 6018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.256763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:52535)
0806 18:43:19.256924 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.256987 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 18:43:19.257882 6018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.257648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:50781)
0806 18:43:19.257769 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.257822 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 18:43:19.258091 6016 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 18:43:19.384407 6020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:19.384783 6020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:19.384876 6020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:19.389328 6020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:19.389477 6020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:19.389585 6020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:19.395634 6020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:32991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=43845
--tserver_master_addrs=127.12.177.190:36099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:19.396989 6020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:19.398449 6020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:19.409538 6027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:19.409538 6029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:19.409670 6026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:19.410059 6020 server_base.cc:1034] running on GCE node
I20260806 18:43:19.410460 6020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:19.411162 6020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:19.412336 6020 hybrid_clock.cc:648] HybridClock initialized: now 1786041799412309 us; error 43 us; skew 500 ppm
Aug 06 18:43:19 dist-test-slave-j2vl krb5kdc[3847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041799, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:19.415484 6020 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:43:19.416477 6020 webserver.cc:460] Webserver started at http://127.12.177.131:43845/ using document root <none> and password file <none>
I20260806 18:43:19.417091 6020 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:19.417194 6020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:19.421547 6020 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 18:43:19.423851 6041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.425485 6020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:19.425645 6020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "777c86fc18344276a6a8fcfd724436db"
format_stamp: "Formatted at 2026-08-06 18:42:37 on dist-test-slave-j2vl"
server_key: "c639bf6220c0e36a7882b95c96fa048b"
server_key_iv: "a2fc9bf0c0202048a99e00747eec010a"
server_key_version: "encryptionkey@0"
I20260806 18:43:19.426286 6020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:19.451542 6020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:19.455768 6020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:19.456137 6020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:19.456875 6020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:19.458094 6020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:19.458187 6020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.458276 6020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:19.458329 6020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:19.470273 6020 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:32991
I20260806 18:43:19.470330 6216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:32991 every 8 connection(s)
I20260806 18:43:19.471484 6020 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:19.473276 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 6020
I20260806 18:43:19.476244 6222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.474123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:35117)
0806 18:43:19.474823 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.474976 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":136,"threads_started":1}
W20260806 18:43:19.476891 6217 heartbeater.cc:644] Failed to heartbeat to 127.12.177.190:36099 (0 consecutive failures): Network error: Failed to ping master at 127.12.177.190:36099: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
I20260806 18:43:19.477924 6222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.477630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:47543)
0806 18:43:19.477764 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.477829 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 18:43:19.478852 6222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:19.478591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:44487)
0806 18:43:19.478740 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:19.478793 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 18:43:19.479082 6217 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 18:43:20.120854 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.120321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:49225)
0806 18:43:20.120656 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:20.120726 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":96,"threads_started":1}
I20260806 18:43:20.259397 6225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.258849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:43155)
0806 18:43:20.259160 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:20.259229 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":87,"threads_started":1}
I20260806 18:43:20.474334 6227 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:20.474560 6227 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:20.475957 6227 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
I20260806 18:43:20.480479 6231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.479674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:40975)
0806 18:43:20.480193 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:20.480291 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":78,"threads_started":1}
Aug 06 18:43:20 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041798, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.130@KRBTEST.COM
Aug 06 18:43:20 dist-test-slave-j2vl krb5kdc[3847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041798, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.131@KRBTEST.COM
I20260806 18:43:20.497172 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.476223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:32991 (local address 127.12.177.129:45999)
0806 18:43:20.476368 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:20.476386 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:20.476502 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:20.479672 (+ 3170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:20.479676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:20.480123 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:20.480753 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:20.480779 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.483651 (+ 2872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.483657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:20.485038 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:20.485053 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.486149 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.486155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:20.486408 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:20.488083 (+ 1675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:20.488117 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:20.490722 (+ 2605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:20.493911 (+ 3189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:20.493915 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:20.493917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:20.494252 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:20.494738 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:20.494744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:20.494747 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:20.494951 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:20.495941 (+ 990us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:20.495951 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:20.496312 (+ 361us) client_negotiation.cc:769] Sending connection context
0806 18:43:20.496547 (+ 235us) client_negotiation.cc:240] Negotiation successful
0806 18:43:20.496966 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":58,"spinlock_wait_cycles":7936}
I20260806 18:43:20.497186 6229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.476601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:45999 (local address 127.12.177.131:32991)
0806 18:43:20.478250 (+ 1649us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:20.478260 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:20.478317 (+ 57us) server_negotiation.cc:407] Connection header received
0806 18:43:20.479025 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:20.479031 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:20.479386 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:20.480129 (+ 743us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:20.481963 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.483416 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.485228 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.486001 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.486956 (+ 955us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:20.491105 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:20.491113 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:20.491128 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:20.491195 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:20.493762 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:20.494408 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:20.494418 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:20.494425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:20.494594 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:20.495088 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:20.495091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:20.495093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:20.495779 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:20.496244 (+ 465us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:20.496706 (+ 462us) server_negotiation.cc:299] Negotiation successful
0806 18:43:20.496996 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1543,"thread_start_us":150,"threads_started":1}
I20260806 18:43:20.497536 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.476762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:37321 (local address 127.12.177.130:44153)
0806 18:43:20.477142 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:20.477168 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:20.477223 (+ 55us) server_negotiation.cc:407] Connection header received
0806 18:43:20.478401 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:20.478413 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:20.478931 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:20.479353 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:20.481278 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.484180 (+ 2902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.486560 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.487267 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.487473 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:20.490759 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:20.490770 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:20.490794 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:20.490847 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:20.493473 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:20.494377 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:20.494433 (+ 56us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:20.494443 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:20.494642 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:20.495107 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:20.495110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:20.495112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:20.495841 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:20.496003 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:20.496914 (+ 911us) server_negotiation.cc:299] Negotiation successful
0806 18:43:20.497261 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
I20260806 18:43:20.497937 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:20.476276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:44153 (local address 127.12.177.129:37321)
0806 18:43:20.476575 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:20.476590 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:20.476709 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:20.479422 (+ 2713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:20.479429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:20.480939 (+ 1510us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:20.481077 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:20.481087 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.484361 (+ 3274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.484365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:20.485104 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:20.485115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:20.487448 (+ 2333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:20.487451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:20.487571 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:20.488156 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:20.488173 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:20.490367 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:20.493636 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:20.493643 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:20.493660 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:20.494208 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:20.494827 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:20.494832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:20.494835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:20.494986 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:20.496078 (+ 1092us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:20.496083 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:20.496308 (+ 225us) client_negotiation.cc:769] Sending connection context
0806 18:43:20.496539 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 18:43:20.497781 (+ 1242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":903,"spinlock_wait_cycles":896,"thread_start_us":78,"threads_started":1}
W20260806 18:43:20.500562 5663 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
W20260806 18:43:20.500905 5664 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:43:20.500996 5664 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7edd61fdb085465caca85a5a19d6d8e2; no voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db
I20260806 18:43:20.501511 6227 raft_consensus.cc:2726] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:43:21.122434 6234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:21.121903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:55097)
0806 18:43:21.122241 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:21.122328 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":87,"threads_started":1}
I20260806 18:43:21.261080 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:21.260485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:47913)
0806 18:43:21.260885 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:21.260956 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":113,"threads_started":1}
I20260806 18:43:21.481940 6236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:21.481416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:57951)
0806 18:43:21.481753 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:21.481828 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":86,"threads_started":1}
I20260806 18:43:22.123922 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:22.123405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:37153)
0806 18:43:22.123727 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:22.123797 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":104,"threads_started":1}
I20260806 18:43:22.262606 6239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:22.262114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:51935)
0806 18:43:22.262432 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:22.262500 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":92,"threads_started":1}
I20260806 18:43:22.483395 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:22.482862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:41373)
0806 18:43:22.483211 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:22.483277 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":134,"threads_started":1}
I20260806 18:43:22.738253 6241 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:22.738420 6241 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:22.738950 6241 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
W20260806 18:43:22.740048 5664 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
W20260806 18:43:22.740322 5663 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:43:22.740437 5663 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7edd61fdb085465caca85a5a19d6d8e2; no voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db
I20260806 18:43:22.740626 6241 raft_consensus.cc:2726] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:43:23.125409 6243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:23.124834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:37901)
0806 18:43:23.125167 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:23.125236 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":109,"threads_started":1}
I20260806 18:43:23.264268 6245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:23.263731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:54111)
0806 18:43:23.264094 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:23.264164 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":130,"threads_started":1}
I20260806 18:43:23.484822 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:23.484331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:47215)
0806 18:43:23.484650 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:23.484718 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":99,"threads_started":1}
I20260806 18:43:24.126976 6249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:24.126421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:39413)
0806 18:43:24.126788 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:24.126855 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":84,"threads_started":1}
I20260806 18:43:24.265893 6251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:24.265221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:50747)
0806 18:43:24.265704 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:24.265765 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":85,"threads_started":1}
I20260806 18:43:24.486393 6252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:24.485874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:59745)
0806 18:43:24.486201 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:24.486269 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":101,"threads_started":1}
I20260806 18:43:24.940213 6254 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:24.940423 6254 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:24.940900 6254 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
W20260806 18:43:24.942018 5664 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
W20260806 18:43:24.942131 5663 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:43:24.942205 5663 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7edd61fdb085465caca85a5a19d6d8e2; no voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db
I20260806 18:43:24.942363 6254 raft_consensus.cc:2726] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:43:25.128458 6256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:25.127946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:55935)
0806 18:43:25.128271 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:25.128332 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":86,"threads_started":1}
I20260806 18:43:25.267586 6258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:25.267095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:55579)
0806 18:43:25.267408 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:25.267480 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":85,"threads_started":1}
I20260806 18:43:25.487761 6259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:25.487298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:45757)
0806 18:43:25.487595 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:25.487656 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":77,"threads_started":1}
I20260806 18:43:26.132087 6260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:26.131036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:32947)
0806 18:43:26.131524 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:26.131627 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":112,"threads_started":1}
I20260806 18:43:26.269394 6261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:26.268703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:52803)
0806 18:43:26.269116 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:26.269217 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":118,"threads_started":1}
I20260806 18:43:26.489674 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:26.488860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:34523)
0806 18:43:26.489297 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:26.489467 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":127,"threads_started":1}
I20260806 18:43:26.851708 6263 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:26.851929 6263 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:26.852641 6263 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
W20260806 18:43:26.853513 5664 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
W20260806 18:43:26.853641 5663 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:43:26.853753 5663 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7edd61fdb085465caca85a5a19d6d8e2; no voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db
I20260806 18:43:26.853940 6263 raft_consensus.cc:2726] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:43:27.133653 6264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:27.133023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:37861)
0806 18:43:27.133464 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:27.133540 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":122,"threads_started":1}
I20260806 18:43:27.271015 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:27.270413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:56731)
0806 18:43:27.270783 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:27.270891 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260806 18:43:27.491077 6268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:27.490559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:51191)
0806 18:43:27.490896 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:27.490970 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260806 18:43:28.135179 6269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:28.134633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:38635)
0806 18:43:28.134990 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:28.135060 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":130,"threads_started":1}
I20260806 18:43:28.272761 6271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:28.272186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:49505)
0806 18:43:28.272579 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:28.272652 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":142,"threads_started":1}
I20260806 18:43:28.492503 6274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:28.491996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:54393)
0806 18:43:28.492327 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:28.492394 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":109,"threads_started":1}
I20260806 18:43:29.137148 6275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:29.136281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:36901)
0806 18:43:29.136883 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:29.136993 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":106,"threads_started":1}
I20260806 18:43:29.274585 6278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:29.274046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:42749)
0806 18:43:29.274379 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:29.274455 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
I20260806 18:43:29.494504 6281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:29.493935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:36069)
0806 18:43:29.494325 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:29.494395 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":122,"threads_started":1}
I20260806 18:43:30.139171 6282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:30.138378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:37661)
0806 18:43:30.138784 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:30.138933 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":135,"threads_started":1}
I20260806 18:43:30.277474 6285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:30.276577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:43049)
0806 18:43:30.277188 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:30.277295 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":251,"threads_started":1}
I20260806 18:43:30.498976 6287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:30.497640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:37891)
0806 18:43:30.498627 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:30.498786 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":326,"threads_started":1}
I20260806 18:43:31.089004 6288 raft_consensus.cc:482] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:31.089197 6288 raft_consensus.cc:504] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b282c97a2da42c98edd42887e56253b" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 44153 } } peers { permanent_uuid: "777c86fc18344276a6a8fcfd724436db" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 32991 } } peers { permanent_uuid: "7edd61fdb085465caca85a5a19d6d8e2" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 39399 } }
I20260806 18:43:31.090093 6288 leader_election.cc:288] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153), 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991)
W20260806 18:43:31.091220 5664 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b282c97a2da42c98edd42887e56253b (127.12.177.130:44153): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
W20260806 18:43:31.091622 5663 leader_election.cc:341] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777c86fc18344276a6a8fcfd724436db (127.12.177.131:32991): Not found: Tablet not found: 6840fabe6b9d48deabfe80c99dc9f2f4
I20260806 18:43:31.091923 5663 leader_election.cc:302] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7edd61fdb085465caca85a5a19d6d8e2; no voters: 4b282c97a2da42c98edd42887e56253b, 777c86fc18344276a6a8fcfd724436db
I20260806 18:43:31.092541 6288 raft_consensus.cc:2726] T 6840fabe6b9d48deabfe80c99dc9f2f4 P 7edd61fdb085465caca85a5a19d6d8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 18:43:31.140781 6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:31.140284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:56103)
0806 18:43:31.140604 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:31.140667 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":87,"threads_started":1}
I20260806 18:43:31.279050 6290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:31.278489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:39411)
0806 18:43:31.278853 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:31.278935 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":93,"threads_started":1}
I20260806 18:43:31.500639 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:31.500113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:54675)
0806 18:43:31.500442 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:31.500514 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":83,"threads_started":1}
I20260806 18:43:32.142433 6293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:32.141885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:49661)
0806 18:43:32.142229 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:32.142302 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":99,"threads_started":1}
I20260806 18:43:32.280639 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:32.280119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:33247)
0806 18:43:32.280457 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:32.280533 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":104,"threads_started":1}
I20260806 18:43:32.502357 6300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:32.501704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:35533)
0806 18:43:32.502074 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:32.502146 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":88,"threads_started":1}
I20260806 18:43:33.144171 6301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:33.143609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:35347)
0806 18:43:33.143991 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:33.144066 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":109,"threads_started":1}
I20260806 18:43:33.282549 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:33.281915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:42847)
0806 18:43:33.282259 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:33.282370 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":106,"threads_started":1}
I20260806 18:43:33.504140 6306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:33.503415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:38195)
0806 18:43:33.503866 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:33.503939 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":215,"threads_started":1}
I20260806 18:43:34.146075 6307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:34.145560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.129:39921)
0806 18:43:34.145909 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:34.145973 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":108,"threads_started":1}
I20260806 18:43:34.284135 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:34.283637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.130:45895)
0806 18:43:34.283958 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:34.284028 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":82,"threads_started":1}
I20260806 18:43:34.481910 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 5579
I20260806 18:43:34.506232 6312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:34.505574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:36099 (local address 127.12.177.131:53347)
0806 18:43:34.506016 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:34.506081 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.190:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":105,"threads_started":1}
I20260806 18:43:34.506420 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 5827
I20260806 18:43:34.524417 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 6020
2026-08-06T18:43:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59984 ms)
[----------] 30 tests from SecurityITest (274065 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:34 dist-test-slave-j2vl krb5kdc[6317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:34 dist-test-slave-j2vl krb5kdc[6317](info): set up 2 sockets
Aug 06 18:43:34 dist-test-slave-j2vl krb5kdc[6317](info): commencing operation
krb5kdc: starting...
W20260806 18:43:35.843928 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:35 dist-test-slave-j2vl krb5kdc[6317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:43:36.001627 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:44247
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:44247
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:36.125434 6340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:36.125774 6340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:36.125870 6340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:36.130239 6340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:36.130324 6340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:36.130344 6340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:36.130362 6340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:36.130379 6340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:36.136479 6340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:44247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:44247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:36.137897 6340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:36.139081 6340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:36.150040 6348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:36.150126 6340 server_base.cc:1034] running on GCE node
W20260806 18:43:36.150061 6353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:36.150098 6347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:36.151175 6340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:36.152627 6340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:36.153880 6340 hybrid_clock.cc:648] HybridClock initialized: now 1786041816153869 us; error 39 us; skew 500 ppm
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:36.157486 6340 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:43:36.158952 6340 webserver.cc:460] Webserver started at http://127.12.177.190:41791/ using document root <none> and password file <none>
I20260806 18:43:36.159785 6340 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:36.159898 6340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:36.160192 6340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:36.162894 6340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "bfce86a183cd4be2ad4d3fda3ff997c0"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "addceabcb2bc4c9d8dce14b208e74df0"
server_key_iv: "d6bac479062a71f9f102f6b9ad23801a"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.163625 6340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "bfce86a183cd4be2ad4d3fda3ff997c0"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "addceabcb2bc4c9d8dce14b208e74df0"
server_key_iv: "d6bac479062a71f9f102f6b9ad23801a"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.169173 6340 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 18:43:36.173498 6363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.176245 6340 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 18:43:36.176515 6340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "bfce86a183cd4be2ad4d3fda3ff997c0"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "addceabcb2bc4c9d8dce14b208e74df0"
server_key_iv: "d6bac479062a71f9f102f6b9ad23801a"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.176723 6340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:36.206485 6340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:36.213470 6340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:36.213804 6340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:36.224366 6340 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:44247
I20260806 18:43:36.224378 6450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:44247 every 8 connection(s)
I20260806 18:43:36.225986 6340 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:36.230865 6451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:36.231581 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 6340
I20260806 18:43:36.231765 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:36.232121 12998 external_mini_cluster.cc:1428] Setting key 87f6c096989666b7a7e43e9822cd67da
I20260806 18:43:36.240422 6451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: Bootstrap starting.
I20260806 18:43:36.243446 6451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: Neither blocks nor log segments found. Creating new log.
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:36.244396 6451 log.cc:824] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:36.247309 6451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: No bootstrap required, opened a new log
I20260806 18:43:36.250924 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:36.233864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56282 (local address 127.12.177.190:44247)
0806 18:43:36.234487 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:36.234504 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:36.234546 (+ 42us) server_negotiation.cc:407] Connection header received
0806 18:43:36.235662 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:36.235692 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:36.236199 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:36.237812 (+ 1613us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:36.238305 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.239865 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.240984 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.241736 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.241959 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:36.245005 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:36.245011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:36.245027 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:36.245059 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:36.247273 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.247837 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.247844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.247850 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.247999 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.248316 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.248319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.248321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.248891 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:36.249093 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:36.249434 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 18:43:36.249809 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":200,"threads_started":1}
I20260806 18:43:36.252209 6451 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } }
I20260806 18:43:36.252522 6451 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:36.252586 6451 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfce86a183cd4be2ad4d3fda3ff997c0, State: Initialized, Role: FOLLOWER
I20260806 18:43:36.253079 6451 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } }
I20260806 18:43:36.253243 6451 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:36.253329 6451 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:36.253456 6451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:36.254514 6451 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } }
I20260806 18:43:36.254904 6451 leader_election.cc:302] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfce86a183cd4be2ad4d3fda3ff997c0; no voters:
I20260806 18:43:36.255280 6451 leader_election.cc:288] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:36.255455 6456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:36.255712 6456 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [term 1 LEADER]: Becoming Leader. State: Replica: bfce86a183cd4be2ad4d3fda3ff997c0, State: Running, Role: LEADER
I20260806 18:43:36.256130 6456 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } }
I20260806 18:43:36.256697 6451 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:36.258268 6458 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfce86a183cd4be2ad4d3fda3ff997c0. Latest consensus state: current_term: 1 leader_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } } }
I20260806 18:43:36.258500 6458 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:36.258265 6457 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfce86a183cd4be2ad4d3fda3ff997c0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 44247 } } }
I20260806 18:43:36.258785 6457 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:36.258980 6470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:36.262460 6470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:36.268602 6470 catalog_manager.cc:1347] Generated new cluster ID: aea7b748a2134aee96a866265b1282ee
I20260806 18:43:36.268707 6470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:36.279238 6470 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:36.280441 6470 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:36.292321 6470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: Generated new TSK 0
I20260806 18:43:36.293233 6470 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:43:36.329950 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:36.456238 6488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:36.456634 6488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:36.456686 6488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:36.461462 6488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:36.461582 6488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:36.461705 6488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:36.470310 6488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:36.471632 6488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:36.472820 6488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:36.484364 6503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:36.484350 6495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:36.484378 6497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:36.484683 6488 server_base.cc:1034] running on GCE node
I20260806 18:43:36.485260 6488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:36.486097 6488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:36.487322 6488 hybrid_clock.cc:648] HybridClock initialized: now 1786041816487302 us; error 34 us; skew 500 ppm
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:36.490624 6488 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:43:36.491655 6488 webserver.cc:460] Webserver started at http://127.12.177.129:46245/ using document root <none> and password file <none>
I20260806 18:43:36.492224 6488 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:36.492290 6488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:36.492482 6488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:36.494751 6488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "47f942dfdcf94c1f9758ec0f5515265f"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "c53045d2c0f3007ba35a0990b498f58d"
server_key_iv: "3a287228f31bbdfe71e4a7731b9f8ff2"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.495332 6488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "47f942dfdcf94c1f9758ec0f5515265f"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "c53045d2c0f3007ba35a0990b498f58d"
server_key_iv: "3a287228f31bbdfe71e4a7731b9f8ff2"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.499675 6488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:36.502375 6520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.503773 6488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:36.503918 6488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "47f942dfdcf94c1f9758ec0f5515265f"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "c53045d2c0f3007ba35a0990b498f58d"
server_key_iv: "3a287228f31bbdfe71e4a7731b9f8ff2"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.504040 6488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:36.519969 6488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:36.523808 6488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:36.524065 6488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:36.524775 6488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:36.525827 6488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:36.525877 6488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.525954 6488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:36.525986 6488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.536648 6488 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:34509
I20260806 18:43:36.536681 6681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:34509 every 8 connection(s)
I20260806 18:43:36.537751 6488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:36.539007 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 6488
I20260806 18:43:36.539263 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:36.539597 12998 external_mini_cluster.cc:1428] Setting key ef1a6ff8ead92a51897023ba9eb2dfa7
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:43:36.555442 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:36.540222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:49367 (local address 127.12.177.190:44247)
0806 18:43:36.540377 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:36.540383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:36.541561 (+ 1178us) server_negotiation.cc:407] Connection header received
0806 18:43:36.543764 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:36.543769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:36.543891 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:36.544009 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:36.545548 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.546109 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.547505 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.547770 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.547897 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:36.550914 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:36.550917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:36.550920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:36.550951 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:36.552629 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.553318 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.553323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.553324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.553503 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.553931 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.553934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.553936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.554201 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:36.554323 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:36.555151 (+ 828us) server_negotiation.cc:299] Negotiation successful
0806 18:43:36.555299 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:43:36.556828 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:36.540694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:44247 (local address 127.12.177.129:49367)
0806 18:43:36.541329 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:36.541442 (+ 113us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:36.543440 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:36.544238 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:36.544246 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:36.544659 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:36.545217 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:36.545241 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.546269 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.546277 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:36.547358 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:36.547371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.547966 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.547971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:36.548160 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:36.548901 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:36.548931 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:36.550674 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:36.552826 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:36.552834 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:36.552861 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:36.553179 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:36.553613 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:36.553618 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:36.553623 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:36.553814 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:36.554334 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:36.554344 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:36.554694 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 18:43:36.554963 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 18:43:36.555426 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":173,"threads_started":1}
I20260806 18:43:36.558346 6682 heartbeater.cc:347] Connected to a master server at 127.12.177.190:44247
I20260806 18:43:36.558658 6682 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:36.559345 6682 heartbeater.cc:511] Master 127.12.177.190:44247 requested a full tablet report, sending...
I20260806 18:43:36.561237 6397 ts_manager.cc:194] Registered new tserver with Master: 47f942dfdcf94c1f9758ec0f5515265f (127.12.177.129:34509)
I20260806 18:43:36.562531 6397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:49367
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:43:36.577939 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:36.708078 6689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:36.708405 6689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:36.708454 6689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:36.712983 6689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:36.713081 6689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:36.713147 6689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:36.719417 6689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:36.720728 6689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:36.721946 6689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:36.732957 6696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:36.732966 6701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:36.733100 6689 server_base.cc:1034] running on GCE node
W20260806 18:43:36.732969 6698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:36.733731 6689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:36.734481 6689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:36.735684 6689 hybrid_clock.cc:648] HybridClock initialized: now 1786041816735665 us; error 39 us; skew 500 ppm
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:36.738821 6689 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:43:36.739882 6689 webserver.cc:460] Webserver started at http://127.12.177.130:41765/ using document root <none> and password file <none>
I20260806 18:43:36.740468 6689 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:36.740540 6689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:36.740724 6689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:36.743037 6689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "ce03219620a84d9b8bea4924fba15169"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "665b5a99687d9ea84f35272f1cdf6cb4"
server_key_iv: "9c0e6d581e2a403c9eb084eb27157e99"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.743624 6689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "ce03219620a84d9b8bea4924fba15169"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "665b5a99687d9ea84f35272f1cdf6cb4"
server_key_iv: "9c0e6d581e2a403c9eb084eb27157e99"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.748028 6689 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:36.751307 6712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.753091 6689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:43:36.753285 6689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "ce03219620a84d9b8bea4924fba15169"
format_stamp: "Formatted at 2026-08-06 18:43:36 on dist-test-slave-j2vl"
server_key: "665b5a99687d9ea84f35272f1cdf6cb4"
server_key_iv: "9c0e6d581e2a403c9eb084eb27157e99"
server_key_version: "encryptionkey@0"
I20260806 18:43:36.753482 6689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:36.780432 6689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:36.784399 6689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:36.784658 6689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:36.785374 6689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:36.786278 6689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:36.786338 6689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.786384 6689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:36.786401 6689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:36.798142 6689 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:37383
I20260806 18:43:36.798168 6872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:37383 every 8 connection(s)
I20260806 18:43:36.799266 6689 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:36.808152 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 6689
I20260806 18:43:36.808321 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:36.808677 12998 external_mini_cluster.cc:1428] Setting key 4c7170b34257b482651f0d0536f5469e
Aug 06 18:43:36 dist-test-slave-j2vl krb5kdc[6317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:36.817487 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:36.801565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:57595 (local address 127.12.177.190:44247)
0806 18:43:36.801777 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:36.801783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:36.802844 (+ 1061us) server_negotiation.cc:407] Connection header received
0806 18:43:36.804306 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:36.804309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:36.804367 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:36.804459 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:36.806120 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.806680 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.808419 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.808703 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.808889 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:36.812621 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:36.812628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:36.812634 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:36.812675 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:36.814449 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.815258 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.815261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.815263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.815406 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:36.815906 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:36.815909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:36.815910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:36.816118 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:36.816199 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:36.817076 (+ 877us) server_negotiation.cc:299] Negotiation successful
0806 18:43:36.817260 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 18:43:36.818949 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:36.802108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:44247 (local address 127.12.177.130:57595)
0806 18:43:36.802663 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:36.802716 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:36.804056 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:36.804701 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:36.804710 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:36.805165 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:36.805921 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:36.805940 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.806856 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.806859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:36.808146 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:36.808162 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:36.808956 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:36.808961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:36.809225 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:36.810128 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:36.810148 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:36.812391 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:36.814609 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:36.814618 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:36.814646 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:36.815132 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:36.815535 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:36.815539 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:36.815542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:36.815785 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:36.816236 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:36.816246 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:36.816736 (+ 490us) client_negotiation.cc:769] Sending connection context
0806 18:43:36.817019 (+ 283us) client_negotiation.cc:240] Negotiation successful
0806 18:43:36.817530 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":145,"threads_started":1}
I20260806 18:43:36.820643 6875 heartbeater.cc:347] Connected to a master server at 127.12.177.190:44247
I20260806 18:43:36.820994 6875 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:36.821733 6875 heartbeater.cc:511] Master 127.12.177.190:44247 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:43:36.823204 6397 ts_manager.cc:194] Registered new tserver with Master: ce03219620a84d9b8bea4924fba15169 (127.12.177.130:37383)
I20260806 18:43:36.823891 6397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:57595
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:43:36.846561 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:36409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:36.979434 6883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:36.979830 6883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:36.979923 6883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:36.986281 6883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:36.986413 6883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:36.986524 6883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:36.992745 6883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:44247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:36.994182 6883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:36.995469 6883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:37.007524 6892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:37.007541 6895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:37.007517 6893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:37.008031 6883 server_base.cc:1034] running on GCE node
I20260806 18:43:37.008599 6883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:37.009577 6883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:37.010802 6883 hybrid_clock.cc:648] HybridClock initialized: now 1786041817010783 us; error 39 us; skew 500 ppm
Aug 06 18:43:37 dist-test-slave-j2vl krb5kdc[6317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:37.014501 6883 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:43:37.015666 6883 webserver.cc:460] Webserver started at http://127.12.177.131:37937/ using document root <none> and password file <none>
I20260806 18:43:37.016395 6883 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:37.016497 6883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:37.016767 6883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:37.020030 6883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "98a4dc72227f4781bc19e7c23282a738"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "b33a8e8723e1893cfe9c0e3d91b4ed24"
server_key_iv: "ecffd76af86096c7e9c47c6db1f0d23b"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.020970 6883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "98a4dc72227f4781bc19e7c23282a738"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "b33a8e8723e1893cfe9c0e3d91b4ed24"
server_key_iv: "ecffd76af86096c7e9c47c6db1f0d23b"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.025974 6883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 18:43:37.029220 6909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:37.030845 6883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:37.031072 6883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "98a4dc72227f4781bc19e7c23282a738"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "b33a8e8723e1893cfe9c0e3d91b4ed24"
server_key_iv: "ecffd76af86096c7e9c47c6db1f0d23b"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.031236 6883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:37.047667 6883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:37.051698 6883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:37.051964 6883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:37.052690 6883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:37.053762 6883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:37.053838 6883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:37.053933 6883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:37.053983 6883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:37.064625 6883 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:36563
I20260806 18:43:37.064724 7074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:36563 every 8 connection(s)
I20260806 18:43:37.065855 6883 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:37.066270 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 6883
I20260806 18:43:37.066416 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:37.066747 12998 external_mini_cluster.cc:1428] Setting key 9910a4ad09cba316d4b62417bb9ec70e
Aug 06 18:43:37 dist-test-slave-j2vl krb5kdc[6317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:37.083770 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.068095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:53247 (local address 127.12.177.190:44247)
0806 18:43:37.068272 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.068276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.069583 (+ 1307us) server_negotiation.cc:407] Connection header received
0806 18:43:37.071450 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.071453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.071520 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.071605 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:37.073176 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.073851 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.075270 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.075544 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.075651 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.078813 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:37.078817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:37.078819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:37.078852 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:37.080959 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:37.081836 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:37.081840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:37.081842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:37.081955 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:37.082480 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:37.082483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:37.082485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:37.082706 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:37.082795 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.083502 (+ 707us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.083637 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 18:43:37.084823 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.068727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:44247 (local address 127.12.177.131:53247)
0806 18:43:37.069381 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.069455 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.070995 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.071837 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.071846 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.072335 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:37.072986 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.073005 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.074024 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.074027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.075107 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.075119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.075752 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.075755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.076014 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.076707 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:37.076728 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:37.078497 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:37.081138 (+ 2641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:37.081147 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:37.081169 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:37.081688 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:37.082089 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:37.082095 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:37.082101 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:37.082342 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:37.082805 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:37.082812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:37.083228 (+ 416us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.083426 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.083745 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":164,"threads_started":1}
I20260806 18:43:37.086289 7075 heartbeater.cc:347] Connected to a master server at 127.12.177.190:44247
I20260806 18:43:37.086586 7075 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:37.087164 7075 heartbeater.cc:511] Master 127.12.177.190:44247 requested a full tablet report, sending...
I20260806 18:43:37.088399 6397 ts_manager.cc:194] Registered new tserver with Master: 98a4dc72227f4781bc19e7c23282a738 (127.12.177.131:36563)
I20260806 18:43:37.088986 6397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:53247
I20260806 18:43:37.094475 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:37.105408 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.096905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56294 (local address 127.12.177.190:44247)
0806 18:43:37.097131 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.097134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.097207 (+ 73us) server_negotiation.cc:407] Connection header received
0806 18:43:37.097319 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.097322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.097433 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.097507 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:37.098288 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.098837 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.099724 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.099959 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.100062 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.101887 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:37.101891 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:37.101893 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:37.101931 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:37.103337 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:37.103809 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:37.103812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:37.103813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:37.103889 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:37.104230 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:37.104234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:37.104235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:37.104527 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:37.104657 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.104969 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.105146 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260806 18:43:37.109014 6397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:37.112363 6397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:37.128780 7103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.122835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.12.177.131:36563)
0806 18:43:37.123237 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.123250 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.123280 (+ 30us) server_negotiation.cc:407] Connection header received
0806 18:43:37.123424 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.123430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.124038 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.124222 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:37.124563 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.125887 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.127289 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.128227 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.128366 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.128497 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.128571 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.128656 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":153,"threads_started":1}
I20260806 18:43:37.128772 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.122422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43404 (local address 127.12.177.129:34509)
0806 18:43:37.122726 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.122734 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.123605 (+ 871us) server_negotiation.cc:407] Connection header received
0806 18:43:37.123842 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.123848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.124065 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.124224 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:37.124697 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.125527 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.127197 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.127926 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.128076 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.128246 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.128456 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.128594 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":104,"threads_started":1}
I20260806 18:43:37.128823 7099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.122236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:36563 (local address 127.0.0.1:57498)
0806 18:43:37.123027 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.123087 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.123240 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.124228 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.124234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.124258 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:37.124422 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.124429 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.126046 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.126050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.127158 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.127167 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.128351 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.128355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.128452 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.128477 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.128535 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.128676 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":132,"threads_started":1}
I20260806 18:43:37.129297 7097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.122235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34509 (local address 127.0.0.1:43404)
0806 18:43:37.123507 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.123521 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.123682 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.124422 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.124425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.124442 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:37.124553 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.124559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.125646 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.125652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.127045 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.127057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.128075 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.128079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.128203 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.128246 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.129048 (+ 802us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.129129 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1197,"mutex_wait_us":185,"thread_start_us":108,"threads_started":1}
I20260806 18:43:37.130067 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.123568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.12.177.130:37383)
0806 18:43:37.124050 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.124063 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.124085 (+ 22us) server_negotiation.cc:407] Connection header received
0806 18:43:37.124168 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.124172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.124339 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.124513 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:37.124757 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.125941 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.127381 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.128227 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.128366 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.128497 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.129403 (+ 906us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.129899 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":126,"threads_started":1}
I20260806 18:43:37.132244 6976 tablet_service.cc:1467] Processing CreateTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 (DEFAULT_TABLE table=test-table [id=cd2dd456fbc049ad907e7bbd19d8f674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:37.132236 6587 tablet_service.cc:1467] Processing CreateTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 (DEFAULT_TABLE table=test-table [id=cd2dd456fbc049ad907e7bbd19d8f674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:37.133257 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.123117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:37383 (local address 127.0.0.1:40352)
0806 18:43:37.123755 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.123769 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.123846 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.124491 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.124495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.124515 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:37.124625 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.124634 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.126128 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.126132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.127244 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.127255 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.129020 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.129024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.129113 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.129148 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.129224 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.129283 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":106,"threads_started":1}
I20260806 18:43:37.133589 6976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b64f7511a1e477a9916847c5fce0f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:37.133594 6587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b64f7511a1e477a9916847c5fce0f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:37.136967 6779 tablet_service.cc:1467] Processing CreateTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 (DEFAULT_TABLE table=test-table [id=cd2dd456fbc049ad907e7bbd19d8f674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:37.138370 6779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b64f7511a1e477a9916847c5fce0f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:37.141248 7108 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Bootstrap starting.
I20260806 18:43:37.143121 7110 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Bootstrap starting.
I20260806 18:43:37.144183 7108 tablet_bootstrap.cc:654] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:37.145251 7108 log.cc:824] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:37.146059 7110 tablet_bootstrap.cc:654] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:37.147635 7110 log.cc:824] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:37.147851 7108 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: No bootstrap required, opened a new log
I20260806 18:43:37.147965 7113 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Bootstrap starting.
I20260806 18:43:37.148175 7108 ts_tablet_manager.cc:1397] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260806 18:43:37.149875 7110 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: No bootstrap required, opened a new log
I20260806 18:43:37.150126 7110 ts_tablet_manager.cc:1397] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 18:43:37.150782 7113 tablet_bootstrap.cc:654] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:37.152395 7113 log.cc:824] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:37.153784 7108 raft_consensus.cc:348] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.154157 7108 raft_consensus.cc:374] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:37.154246 7108 raft_consensus.cc:729] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f942dfdcf94c1f9758ec0f5515265f, State: Initialized, Role: FOLLOWER
I20260806 18:43:37.154158 7110 raft_consensus.cc:348] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.154479 7110 raft_consensus.cc:374] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:37.154547 7110 raft_consensus.cc:729] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a4dc72227f4781bc19e7c23282a738, State: Initialized, Role: FOLLOWER
I20260806 18:43:37.154863 7108 consensus_queue.cc:260] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.155015 7110 consensus_queue.cc:260] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.155810 7075 heartbeater.cc:503] Master 127.12.177.190:44247 was elected leader, sending a full tablet report...
I20260806 18:43:37.156008 7113 tablet_bootstrap.cc:492] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: No bootstrap required, opened a new log
I20260806 18:43:37.156273 7113 ts_tablet_manager.cc:1397] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 18:43:37.156282 7108 ts_tablet_manager.cc:1428] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260806 18:43:37.156705 6682 heartbeater.cc:503] Master 127.12.177.190:44247 was elected leader, sending a full tablet report...
I20260806 18:43:37.157807 7110 ts_tablet_manager.cc:1428] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 18:43:37.161751 7113 raft_consensus.cc:348] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.162178 7113 raft_consensus.cc:374] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:37.162262 7113 raft_consensus.cc:729] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce03219620a84d9b8bea4924fba15169, State: Initialized, Role: FOLLOWER
I20260806 18:43:37.162863 7113 consensus_queue.cc:260] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.163738 6875 heartbeater.cc:503] Master 127.12.177.190:44247 was elected leader, sending a full tablet report...
I20260806 18:43:37.164026 7113 ts_tablet_manager.cc:1428] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260806 18:43:37.289537 6683 tablet.cc:2369] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:43:37.300796 6876 tablet.cc:2369] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:43:37.317312 7081 tablet.cc:2369] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:37.347137 7117 raft_consensus.cc:482] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:37.347801 7117 raft_consensus.cc:504] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.349146 7117 leader_election.cc:288] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f942dfdcf94c1f9758ec0f5515265f (127.12.177.129:34509), ce03219620a84d9b8bea4924fba15169 (127.12.177.130:37383)
I20260806 18:43:37.355690 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.349811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:39799 (local address 127.12.177.129:34509)
0806 18:43:37.349979 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.349986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.350020 (+ 34us) server_negotiation.cc:407] Connection header received
0806 18:43:37.350241 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.350245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.350302 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.350580 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:37.351136 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.351955 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354076 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.354756 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354912 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.354978 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.355431 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.355533 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 18:43:37.355690 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.350031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:34691 (local address 127.12.177.130:37383)
0806 18:43:37.350298 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.350303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.350321 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:43:37.350563 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.350566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.350625 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.350705 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:37.351136 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.351956 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354076 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.354756 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354912 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.354978 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.355431 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.355533 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260806 18:43:37.355702 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.349594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34509 (local address 127.12.177.131:39799)
0806 18:43:37.349787 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.349805 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.349943 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.350648 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.350651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.350751 (+ 100us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:37.350973 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.350979 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.352120 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.352124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.353875 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.353892 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.354947 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.355213 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.355273 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.355370 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.355499 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":287,"spinlock_wait_cycles":45952}
I20260806 18:43:37.355734 7123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.349885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:37383 (local address 127.12.177.131:34691)
0806 18:43:37.350248 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.350260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:37.350346 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:37.350782 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:37.350785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:37.350834 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:37.350959 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.350965 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.352120 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.352124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.353875 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:37.353892 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.354947 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.354952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:37.355217 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.355273 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 18:43:37.355370 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 18:43:37.355499 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":201,"spinlock_wait_cycles":2816,"thread_start_us":166,"threads_started":1}
I20260806 18:43:37.356629 6808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b64f7511a1e477a9916847c5fce0f02" candidate_uuid: "98a4dc72227f4781bc19e7c23282a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce03219620a84d9b8bea4924fba15169" is_pre_election: true
I20260806 18:43:37.356631 6618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b64f7511a1e477a9916847c5fce0f02" candidate_uuid: "98a4dc72227f4781bc19e7c23282a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f942dfdcf94c1f9758ec0f5515265f" is_pre_election: true
I20260806 18:43:37.357084 6618 raft_consensus.cc:2454] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a4dc72227f4781bc19e7c23282a738 in term 0.
I20260806 18:43:37.357084 6808 raft_consensus.cc:2454] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a4dc72227f4781bc19e7c23282a738 in term 0.
I20260806 18:43:37.357712 6914 leader_election.cc:302] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f942dfdcf94c1f9758ec0f5515265f, 98a4dc72227f4781bc19e7c23282a738; no voters:
I20260806 18:43:37.358059 7117 raft_consensus.cc:2781] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:37.358196 7117 raft_consensus.cc:482] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:37.358247 7117 raft_consensus.cc:3037] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:37.360342 7117 raft_consensus.cc:504] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.360821 7117 leader_election.cc:288] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [CANDIDATE]: Term 1 election: Requested vote from peers 47f942dfdcf94c1f9758ec0f5515265f (127.12.177.129:34509), ce03219620a84d9b8bea4924fba15169 (127.12.177.130:37383)
I20260806 18:43:37.361572 6808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b64f7511a1e477a9916847c5fce0f02" candidate_uuid: "98a4dc72227f4781bc19e7c23282a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce03219620a84d9b8bea4924fba15169"
I20260806 18:43:37.361599 6618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b64f7511a1e477a9916847c5fce0f02" candidate_uuid: "98a4dc72227f4781bc19e7c23282a738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f942dfdcf94c1f9758ec0f5515265f"
I20260806 18:43:37.361763 6808 raft_consensus.cc:3037] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:37.361779 6618 raft_consensus.cc:3037] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:37.363070 6618 raft_consensus.cc:2454] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a4dc72227f4781bc19e7c23282a738 in term 1.
I20260806 18:43:37.363085 6808 raft_consensus.cc:2454] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a4dc72227f4781bc19e7c23282a738 in term 1.
I20260806 18:43:37.363579 6914 leader_election.cc:302] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98a4dc72227f4781bc19e7c23282a738, ce03219620a84d9b8bea4924fba15169; no voters:
I20260806 18:43:37.363812 7117 raft_consensus.cc:2781] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:37.364117 7117 raft_consensus.cc:686] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 1 LEADER]: Becoming Leader. State: Replica: 98a4dc72227f4781bc19e7c23282a738, State: Running, Role: LEADER
I20260806 18:43:37.364596 7117 consensus_queue.cc:237] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } }
I20260806 18:43:37.369119 6394 catalog_manager.cc:5495] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98a4dc72227f4781bc19e7c23282a738 (127.12.177.131). New cstate: current_term: 1 leader_uuid: "98a4dc72227f4781bc19e7c23282a738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a4dc72227f4781bc19e7c23282a738" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 36563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 } health_report { overall_health: UNKNOWN } } }
I20260806 18:43:37.428906 7103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.424879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57508 (local address 127.12.177.131:36563)
0806 18:43:37.425068 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.425074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.425094 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:43:37.425184 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.425186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.425248 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.425454 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:37.425742 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.426279 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.427206 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.427445 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.427567 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.427945 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:37.428446 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:37.428595 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.428659 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.428733 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:43:37.436307 6808 raft_consensus.cc:1261] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 1 FOLLOWER]: Refusing update from remote peer 98a4dc72227f4781bc19e7c23282a738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:37.436307 6618 raft_consensus.cc:1261] T 4b64f7511a1e477a9916847c5fce0f02 P 47f942dfdcf94c1f9758ec0f5515265f [term 1 FOLLOWER]: Refusing update from remote peer 98a4dc72227f4781bc19e7c23282a738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:37.437348 7117 consensus_queue.cc:1035] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce03219620a84d9b8bea4924fba15169" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 37383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:37.437736 7124 consensus_queue.cc:1035] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f942dfdcf94c1f9758ec0f5515265f" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 34509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:37.448292 7131 mvcc.cc:205] Tried to move back new op lower bound from 7315627284208979968 to 7315627283928842240. Current Snapshot: MvccSnapshot[applied={T|T < 7315627284208979968}]
I20260806 18:43:37.458755 6394 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:37.459020 6394 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:37.462131 6394 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bfce86a183cd4be2ad4d3fda3ff997c0: Sending DeleteTablet for 3 replicas of tablet 4b64f7511a1e477a9916847c5fce0f02
I20260806 18:43:37.463295 6976 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:57498
I20260806 18:43:37.463387 6779 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:40352
I20260806 18:43:37.463374 6587 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b64f7511a1e477a9916847c5fce0f02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:37 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:43404
I20260806 18:43:37.464378 7148 tablet_replica.cc:330] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: stopping tablet replica
I20260806 18:43:37.464915 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 6488
I20260806 18:43:37.464902 7148 raft_consensus.cc:2229] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:37.477896 7148 raft_consensus.cc:2258] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:37.483171 7148 ts_tablet_manager.cc:1905] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:37.485139 7150 tablet_replica.cc:330] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: stopping tablet replica
I20260806 18:43:37.487594 7150 raft_consensus.cc:2229] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:43:37.488348 7150 raft_consensus.cc:2258] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:37.490610 7150 ts_tablet_manager.cc:1905] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:37.491894 7148 ts_tablet_manager.cc:1918] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:37.492058 7148 log.cc:1196] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/4b64f7511a1e477a9916847c5fce0f02
I20260806 18:43:37.492470 7148 ts_tablet_manager.cc:1939] T 4b64f7511a1e477a9916847c5fce0f02 P ce03219620a84d9b8bea4924fba15169: Deleting consensus metadata
I20260806 18:43:37.494426 6379 catalog_manager.cc:4841] TS ce03219620a84d9b8bea4924fba15169 (127.12.177.130:37383): tablet 4b64f7511a1e477a9916847c5fce0f02 (table test-table [id=cd2dd456fbc049ad907e7bbd19d8f674]) successfully deleted
I20260806 18:43:37.494750 7150 ts_tablet_manager.cc:1918] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:37.494884 7150 log.cc:1196] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/4b64f7511a1e477a9916847c5fce0f02
I20260806 18:43:37.495223 7150 ts_tablet_manager.cc:1939] T 4b64f7511a1e477a9916847c5fce0f02 P 98a4dc72227f4781bc19e7c23282a738: Deleting consensus metadata
W20260806 18:43:37.496345 6379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:34509 (error 108)
I20260806 18:43:37.496680 6368 catalog_manager.cc:4841] TS 98a4dc72227f4781bc19e7c23282a738 (127.12.177.131:36563): tablet 4b64f7511a1e477a9916847c5fce0f02 (table test-table [id=cd2dd456fbc049ad907e7bbd19d8f674]) successfully deleted
I20260806 18:43:37.496781 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 6689
I20260806 18:43:37.512012 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.511431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:34509 (local address 127.0.0.1:43418)
0806 18:43:37.511691 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:37.511842 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:34509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260806 18:43:37.512355 6379 catalog_manager.cc:4584] TS 47f942dfdcf94c1f9758ec0f5515265f (127.12.177.129:34509): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4b64f7511a1e477a9916847c5fce0f02: Network error: Client connection negotiation failed: client connection to 127.12.177.129:34509: connect: Connection refused (error 111)
I20260806 18:43:37.527339 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 6883
I20260806 18:43:37.545086 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 6340
2026-08-06T18:43:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (3021 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T18:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:37Z Disabled control of system clock
I20260806 18:43:37.591958 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34167
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:34167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:37.718308 7157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:37.718653 7157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:37.718693 7157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:37.723282 7157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:37.723384 7157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:37.723402 7157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:37.723419 7157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:37.723436 7157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:37.728691 7157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:34167
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:34167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:37.730085 7157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:37.731587 7157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:37.741469 7165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:37.741469 7163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:37.741472 7167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:37.741787 7157 server_base.cc:1034] running on GCE node
I20260806 18:43:37.742918 7157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:37.744270 7157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:37.745493 7157 hybrid_clock.cc:648] HybridClock initialized: now 1786041817745462 us; error 55 us; skew 500 ppm
I20260806 18:43:37.748092 7157 webserver.cc:460] Webserver started at http://127.12.177.190:40173/ using document root <none> and password file <none>
I20260806 18:43:37.749059 7157 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:37.749210 7157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:37.749564 7157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:37.752089 7157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "0646e3419e8448939397b15035df2bbd"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "782bc1d856a30a8b61a3121b809e97b7"
server_key_iv: "b341907a7ba756e8f2ec52db00a075df"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.752796 7157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "0646e3419e8448939397b15035df2bbd"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "782bc1d856a30a8b61a3121b809e97b7"
server_key_iv: "b341907a7ba756e8f2ec52db00a075df"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.757318 7157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:43:37.760419 7176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:37.762154 7157 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 18:43:37.762308 7157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "0646e3419e8448939397b15035df2bbd"
format_stamp: "Formatted at 2026-08-06 18:43:37 on dist-test-slave-j2vl"
server_key: "782bc1d856a30a8b61a3121b809e97b7"
server_key_iv: "b341907a7ba756e8f2ec52db00a075df"
server_key_version: "encryptionkey@0"
I20260806 18:43:37.762511 7157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:37.782749 7157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:37.783641 7157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:37.783882 7157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:37.794770 7157 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:34167
I20260806 18:43:37.794793 7255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:34167 every 8 connection(s)
I20260806 18:43:37.796130 7157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:37.800421 7259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:37.801574 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 7157
I20260806 18:43:37.801721 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:37.802060 12998 external_mini_cluster.cc:1428] Setting key 5201ebf27c8920a14b893831aab4bd9d
I20260806 18:43:37.809584 7259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: Bootstrap starting.
I20260806 18:43:37.812714 7259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:37.813776 7259 log.cc:824] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:37.814811 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:37.803704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.12.177.190:34167)
0806 18:43:37.804537 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:37.804554 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:37.804598 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:43:37.805591 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:37.805617 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:37.806126 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:37.806528 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:37.807036 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.808097 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.809095 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:37.809730 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:37.809940 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:37.812000 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:37.812013 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:37.812030 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:37.812509 (+ 479us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:37.812582 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:37.812608 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:37.812703 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:37.813289 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 18:43:37.813641 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":191,"threads_started":1}
I20260806 18:43:37.816740 7259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: No bootstrap required, opened a new log
I20260806 18:43:37.821280 7259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } }
I20260806 18:43:37.821712 7259 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:37.821796 7259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646e3419e8448939397b15035df2bbd, State: Initialized, Role: FOLLOWER
I20260806 18:43:37.822345 7259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } }
I20260806 18:43:37.822551 7259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:37.822631 7259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:37.822718 7259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:37.823833 7259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } }
I20260806 18:43:37.824205 7259 leader_election.cc:302] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0646e3419e8448939397b15035df2bbd; no voters:
I20260806 18:43:37.824585 7259 leader_election.cc:288] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:37.824685 7264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:37.824921 7264 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [term 1 LEADER]: Becoming Leader. State: Replica: 0646e3419e8448939397b15035df2bbd, State: Running, Role: LEADER
I20260806 18:43:37.825284 7264 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } }
I20260806 18:43:37.826254 7259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:37.827984 7265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0646e3419e8448939397b15035df2bbd. Latest consensus state: current_term: 1 leader_uuid: "0646e3419e8448939397b15035df2bbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } } }
I20260806 18:43:37.828039 7268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0646e3419e8448939397b15035df2bbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0646e3419e8448939397b15035df2bbd" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 34167 } } }
I20260806 18:43:37.828174 7268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:37.828171 7265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:37.828661 7283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:37.832473 7283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:37.840266 7283 catalog_manager.cc:1347] Generated new cluster ID: dd28331140a242748dae46b875342887
I20260806 18:43:37.840374 7283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:37.860469 7283 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:37.861806 7283 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:37.871249 7283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: Generated new TSK 0
I20260806 18:43:37.872208 7283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:37.877161 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--builtin_ntp_servers=127.12.177.148:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:38.019613 7303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:38.020090 7303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:38.020191 7303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:38.024756 7303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:38.024897 7303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:38.025012 7303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:38.030902 7303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:38.032269 7303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:38.033919 7303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:38.045322 7317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:38.045504 7314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:38.045480 7303 server_base.cc:1034] running on GCE node
W20260806 18:43:38.045322 7315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:38.046176 7303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:38.046917 7303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:38.048151 7303 hybrid_clock.cc:648] HybridClock initialized: now 1786041818048130 us; error 32 us; skew 500 ppm
I20260806 18:43:38.050661 7303 webserver.cc:460] Webserver started at http://127.12.177.129:39231/ using document root <none> and password file <none>
I20260806 18:43:38.051367 7303 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:38.051486 7303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:38.051766 7303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:38.054347 7303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "c60d68832aaf477eb4247e1fa81f46e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "0cac17f0247b25c373211a3ed8c6c505"
server_key_iv: "e7c9f77c922f688c53cf9bb81e81ca75"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.055073 7303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "c60d68832aaf477eb4247e1fa81f46e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "0cac17f0247b25c373211a3ed8c6c505"
server_key_iv: "e7c9f77c922f688c53cf9bb81e81ca75"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.059489 7303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:38.062598 7329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.064121 7303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 18:43:38.064324 7303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "c60d68832aaf477eb4247e1fa81f46e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "0cac17f0247b25c373211a3ed8c6c505"
server_key_iv: "e7c9f77c922f688c53cf9bb81e81ca75"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.064489 7303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:38.093155 7303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:38.094071 7303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:38.094302 7303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:38.095031 7303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:38.096118 7303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:38.096197 7303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.096294 7303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:38.096338 7303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.106608 7303 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:45213
I20260806 18:43:38.106642 7509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:45213 every 8 connection(s)
I20260806 18:43:38.107697 7303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:38.108369 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 7303
I20260806 18:43:38.108564 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:38.108906 12998 external_mini_cluster.cc:1428] Setting key 26863dda0e510fe9590b3014f2ecef2f
I20260806 18:43:38.111493 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--builtin_ntp_servers=127.12.177.148:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:38.119215 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.110136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:47469 (local address 127.12.177.190:34167)
0806 18:43:38.110311 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.110316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.112047 (+ 1731us) server_negotiation.cc:407] Connection header received
0806 18:43:38.113661 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.113665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.113735 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.113858 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:38.114950 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.115511 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.116852 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.117094 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.117220 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.118633 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:38.118637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:38.118639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:38.118655 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:38.118676 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:38.118685 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:38.118769 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.118960 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.119046 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 18:43:38.120416 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.110956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34167 (local address 127.12.177.129:47469)
0806 18:43:38.111836 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.111901 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.113329 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.114081 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.114090 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.114193 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:38.114773 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.114788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.115680 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.115684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.116685 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.116697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.117290 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.117295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.117540 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.118277 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:38.118279 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:38.118332 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:38.118421 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:38.118772 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:38.118786 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:38.118793 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.118961 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.119329 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":189,"threads_started":1}
I20260806 18:43:38.122252 7510 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34167
I20260806 18:43:38.122568 7510 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:38.123237 7510 heartbeater.cc:511] Master 127.12.177.190:34167 requested a full tablet report, sending...
I20260806 18:43:38.125236 7198 ts_manager.cc:194] Registered new tserver with Master: c60d68832aaf477eb4247e1fa81f46e1 (127.12.177.129:45213)
I20260806 18:43:38.127027 7198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.129:47469
W20260806 18:43:38.243450 7516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:38.243916 7516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:38.243985 7516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:38.251058 7516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:38.251152 7516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:38.251221 7516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:38.259430 7516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:38.260995 7516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:38.262813 7516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:38.275206 7532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:38.275326 7524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:38.275493 7516 server_base.cc:1034] running on GCE node
W20260806 18:43:38.275206 7527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:38.276188 7516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:38.277053 7516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:38.278280 7516 hybrid_clock.cc:648] HybridClock initialized: now 1786041818278248 us; error 42 us; skew 500 ppm
I20260806 18:43:38.280778 7516 webserver.cc:460] Webserver started at http://127.12.177.130:36919/ using document root <none> and password file <none>
I20260806 18:43:38.281553 7516 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:38.281634 7516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:38.282032 7516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:38.284672 7516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "eeb3b8e171bd4762bae08164285a06e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "c83974b938561c91fed36c834a56b294"
server_key_iv: "83db3df46a58e20ee5a573b26d9edb18"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.285455 7516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "eeb3b8e171bd4762bae08164285a06e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "c83974b938561c91fed36c834a56b294"
server_key_iv: "83db3df46a58e20ee5a573b26d9edb18"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.291273 7516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 18:43:38.295425 7541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.297616 7516 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 18:43:38.297811 7516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "eeb3b8e171bd4762bae08164285a06e1"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "c83974b938561c91fed36c834a56b294"
server_key_iv: "83db3df46a58e20ee5a573b26d9edb18"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.297978 7516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:38.319128 7516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:38.320035 7516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:38.320276 7516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:38.321079 7516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:38.322549 7516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:38.322621 7516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.322667 7516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:38.322683 7516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.336602 7516 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:35003
I20260806 18:43:38.336627 7713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:35003 every 8 connection(s)
I20260806 18:43:38.337805 7516 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:38.342118 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 7516
I20260806 18:43:38.342262 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:38.342553 12998 external_mini_cluster.cc:1428] Setting key e2135e93127c36bbd4f946a9607c98be
I20260806 18:43:38.344897 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--builtin_ntp_servers=127.12.177.148:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:38.352403 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.340484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:48691 (local address 127.12.177.190:34167)
0806 18:43:38.340678 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.340683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.342243 (+ 1560us) server_negotiation.cc:407] Connection header received
0806 18:43:38.344070 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.344074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.344133 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.344212 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:38.345788 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.346341 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.348141 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.348740 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.348874 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.351483 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:38.351490 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:38.351495 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:38.351517 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:38.351546 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:38.351578 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:38.351634 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.351999 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.352140 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 18:43:38.353515 7718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.340926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34167 (local address 127.12.177.130:48691)
0806 18:43:38.342034 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.342092 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.343812 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.344470 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.344481 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.344619 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:38.345543 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.345572 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.346520 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.346526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.347932 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.347947 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.349153 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.349161 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.349466 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.350904 (+ 1438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:38.350915 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:38.351003 (+ 88us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:38.351147 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:38.351740 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:38.351762 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:38.351770 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.351961 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.352377 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":144,"threads_started":1}
I20260806 18:43:38.356112 7715 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34167
I20260806 18:43:38.356465 7715 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:38.357161 7715 heartbeater.cc:511] Master 127.12.177.190:34167 requested a full tablet report, sending...
I20260806 18:43:38.359126 7198 ts_manager.cc:194] Registered new tserver with Master: eeb3b8e171bd4762bae08164285a06e1 (127.12.177.130:35003)
I20260806 18:43:38.359826 7198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.130:48691
W20260806 18:43:38.492185 7719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:38.492549 7719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:38.492594 7719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:38.497299 7719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:38.497468 7719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:38.497539 7719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:38.503170 7719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:34167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:38.504540 7719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:38.506261 7719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 18:43:38.518016 7719 server_base.cc:1034] running on GCE node
W20260806 18:43:38.518252 7727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:38.518280 7730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:38.518303 7726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:38.519100 7719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:38.519934 7719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:38.521157 7719 hybrid_clock.cc:648] HybridClock initialized: now 1786041818521118 us; error 54 us; skew 500 ppm
I20260806 18:43:38.523994 7719 webserver.cc:460] Webserver started at http://127.12.177.131:33231/ using document root <none> and password file <none>
I20260806 18:43:38.524755 7719 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:38.524870 7719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:38.525115 7719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:38.528338 7719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "a0b333c5bd3444f5907b304f4700d25e"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "32e77118347fec5f15035935ec3138ef"
server_key_iv: "b85c013e3434d000a0db6fac1ff90041"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.529170 7719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "a0b333c5bd3444f5907b304f4700d25e"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "32e77118347fec5f15035935ec3138ef"
server_key_iv: "b85c013e3434d000a0db6fac1ff90041"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.533972 7719 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:43:38.537549 7736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.539424 7719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:43:38.539615 7719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "a0b333c5bd3444f5907b304f4700d25e"
format_stamp: "Formatted at 2026-08-06 18:43:38 on dist-test-slave-j2vl"
server_key: "32e77118347fec5f15035935ec3138ef"
server_key_iv: "b85c013e3434d000a0db6fac1ff90041"
server_key_version: "encryptionkey@0"
I20260806 18:43:38.539772 7719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:38.555380 7719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:38.556433 7719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:38.556668 7719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:38.557451 7719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:38.558653 7719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:38.558735 7719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.558815 7719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:38.558856 7719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:38.571228 7719 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:41211
I20260806 18:43:38.571262 7917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:41211 every 8 connection(s)
I20260806 18:43:38.572757 7719 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:38.576936 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 7719
I20260806 18:43:38.577106 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:38.577540 12998 external_mini_cluster.cc:1428] Setting key 18cd5b321e55c6753f29731fc61b12c5
I20260806 18:43:38.584923 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.575132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:43709 (local address 127.12.177.190:34167)
0806 18:43:38.575284 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.575289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.576611 (+ 1322us) server_negotiation.cc:407] Connection header received
0806 18:43:38.578620 (+ 2009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.578624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.578691 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.578933 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:38.580671 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.581243 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.582672 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.582930 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.583027 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.584376 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:38.584379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:38.584381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:38.584398 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:38.584420 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:38.584429 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:38.584509 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.584715 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.584785 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:43:38.586102 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.575534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:34167 (local address 127.12.177.131:43709)
0806 18:43:38.576406 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.576459 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.578356 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.579220 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.579232 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.579371 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:38.580462 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.580491 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.581470 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.581478 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.582498 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.582511 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.583096 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.583098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.583267 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.584031 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:38.584032 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:38.584083 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:38.584170 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:38.584550 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:38.584560 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:38.584566 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.584700 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.585053 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":175,"threads_started":1}
I20260806 18:43:38.587666 7918 heartbeater.cc:347] Connected to a master server at 127.12.177.190:34167
I20260806 18:43:38.587998 7918 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:38.588689 7918 heartbeater.cc:511] Master 127.12.177.190:34167 requested a full tablet report, sending...
I20260806 18:43:38.590261 7198 ts_manager.cc:194] Registered new tserver with Master: a0b333c5bd3444f5907b304f4700d25e (127.12.177.131:41211)
I20260806 18:43:38.591002 7198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.131:43709
I20260806 18:43:38.594355 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:38.602097 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.597063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60208 (local address 127.12.177.190:34167)
0806 18:43:38.597227 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.597231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.597249 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:43:38.597476 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.597479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.597528 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.597612 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:38.598075 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.598840 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.600025 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.600254 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.600366 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.601585 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:38.601591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:38.601596 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:38.601623 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:38.601646 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:38.601655 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:38.601727 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.601883 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.601960 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 18:43:38.606551 7198 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:38.610476 7198 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:38.630366 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.623415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:35003 (local address 127.0.0.1:49286)
0806 18:43:38.624342 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.624358 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.624520 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.625308 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.625315 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.625872 (+ 557us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:38.626001 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.626009 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.627439 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.627443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.628471 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.628483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.629715 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.629718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.629846 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.629892 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.630025 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.630173 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"mutex_wait_us":1,"spinlock_wait_cycles":17152,"thread_start_us":125,"threads_started":1}
I20260806 18:43:38.630363 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.623590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49286 (local address 127.12.177.130:35003)
0806 18:43:38.624076 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.624092 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.624453 (+ 361us) server_negotiation.cc:407] Connection header received
0806 18:43:38.624701 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.624708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.624931 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.625099 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:38.626148 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.627316 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.628630 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.629580 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.629728 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.629923 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.630059 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.630172 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":117,"threads_started":1}
I20260806 18:43:38.630430 7936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.623550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45213 (local address 127.0.0.1:59834)
0806 18:43:38.624766 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.624790 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.625089 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.625639 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.625644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.625665 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:38.625770 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.625780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.627305 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.627309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.628538 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.628546 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.630000 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.630004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.630074 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.630093 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.630193 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.630275 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"mutex_wait_us":6,"thread_start_us":105,"threads_started":1}
I20260806 18:43:38.631028 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.623058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:41211 (local address 127.0.0.1:42980)
0806 18:43:38.624288 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.624357 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.624522 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.625308 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.625315 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.625390 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:38.625543 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.625550 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.626877 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.626880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.628510 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.628523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.630571 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.630575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.630686 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.630719 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.630806 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.630890 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"mutex_wait_us":104,"spinlock_wait_cycles":7296,"thread_start_us":108,"threads_started":1}
I20260806 18:43:38.631217 7943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.623911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.12.177.131:41211)
0806 18:43:38.624500 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.624513 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.624538 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:43:38.624682 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.624688 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.624934 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.625117 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:38.625726 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.626752 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.628674 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.629578 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.629708 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.629922 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.630869 (+ 947us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.631009 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":160,"threads_started":1}
I20260806 18:43:38.631376 7946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.624010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.12.177.129:45213)
0806 18:43:38.624357 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.624366 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.624910 (+ 544us) server_negotiation.cc:407] Connection header received
0806 18:43:38.625261 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.625266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.625496 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.625644 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:38.625939 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.627167 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.628674 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.629569 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.629709 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.629923 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.630231 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.630344 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":133,"threads_started":1}
I20260806 18:43:38.634086 7609 tablet_service.cc:1467] Processing CreateTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 (DEFAULT_TABLE table=test-table [id=d3a8229d004548a4a649ad710442af04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:38.634150 7826 tablet_service.cc:1467] Processing CreateTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 (DEFAULT_TABLE table=test-table [id=d3a8229d004548a4a649ad710442af04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:38.634150 7403 tablet_service.cc:1467] Processing CreateTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 (DEFAULT_TABLE table=test-table [id=d3a8229d004548a4a649ad710442af04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:38.635251 7609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23860e8ac5df4fb4b52f5052054affe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:38.635275 7826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23860e8ac5df4fb4b52f5052054affe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:38.635275 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23860e8ac5df4fb4b52f5052054affe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:38.642735 7947 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Bootstrap starting.
I20260806 18:43:38.643585 7950 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Bootstrap starting.
I20260806 18:43:38.644541 7948 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: Bootstrap starting.
I20260806 18:43:38.646265 7950 tablet_bootstrap.cc:654] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:38.646288 7947 tablet_bootstrap.cc:654] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:38.646713 7948 tablet_bootstrap.cc:654] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:38.647307 7950 log.cc:824] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:38.647486 7947 log.cc:824] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:38.647534 7948 log.cc:824] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:38.650208 7950 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: No bootstrap required, opened a new log
I20260806 18:43:38.650209 7948 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: No bootstrap required, opened a new log
I20260806 18:43:38.650632 7948 ts_tablet_manager.cc:1397] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260806 18:43:38.650632 7950 ts_tablet_manager.cc:1397] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:43:38.650898 7947 tablet_bootstrap.cc:492] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: No bootstrap required, opened a new log
I20260806 18:43:38.651139 7947 ts_tablet_manager.cc:1397] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 18:43:38.655193 7947 raft_consensus.cc:348] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.655548 7947 raft_consensus.cc:374] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:38.655613 7947 raft_consensus.cc:729] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb3b8e171bd4762bae08164285a06e1, State: Initialized, Role: FOLLOWER
I20260806 18:43:38.656157 7947 consensus_queue.cc:260] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.656157 7950 raft_consensus.cc:348] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.656525 7950 raft_consensus.cc:374] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:38.656601 7950 raft_consensus.cc:729] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b333c5bd3444f5907b304f4700d25e, State: Initialized, Role: FOLLOWER
I20260806 18:43:38.656589 7948 raft_consensus.cc:348] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.657086 7715 heartbeater.cc:503] Master 127.12.177.190:34167 was elected leader, sending a full tablet report...
I20260806 18:43:38.657140 7948 raft_consensus.cc:374] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:38.657223 7948 raft_consensus.cc:729] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c60d68832aaf477eb4247e1fa81f46e1, State: Initialized, Role: FOLLOWER
I20260806 18:43:38.657482 7947 ts_tablet_manager.cc:1428] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260806 18:43:38.657473 7950 consensus_queue.cc:260] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.657759 7948 consensus_queue.cc:260] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.658339 7918 heartbeater.cc:503] Master 127.12.177.190:34167 was elected leader, sending a full tablet report...
I20260806 18:43:38.658875 7510 heartbeater.cc:503] Master 127.12.177.190:34167 was elected leader, sending a full tablet report...
I20260806 18:43:38.659765 7948 ts_tablet_manager.cc:1428] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: Time spent starting tablet: real 0.009s user 0.006s sys 0.003s
I20260806 18:43:38.661311 7950 ts_tablet_manager.cc:1428] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260806 18:43:38.768620 7959 raft_consensus.cc:482] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:38.768944 7959 raft_consensus.cc:504] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.770394 7959 leader_election.cc:288] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eeb3b8e171bd4762bae08164285a06e1 (127.12.177.130:35003), c60d68832aaf477eb4247e1fa81f46e1 (127.12.177.129:45213)
I20260806 18:43:38.774645 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.770967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:46907 (local address 127.12.177.130:35003)
0806 18:43:38.771102 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.771107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.771191 (+ 84us) server_negotiation.cc:407] Connection header received
0806 18:43:38.771352 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.771355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.771410 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.771529 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:38.771830 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.772347 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.773593 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.774013 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.774153 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.774212 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.774418 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.774499 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:43:38.774645 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.770770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:35003 (local address 127.12.177.131:46907)
0806 18:43:38.771102 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.771119 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.771249 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.771546 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.771550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.771570 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:38.771704 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.771710 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.772486 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.772490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.773441 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.773455 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.774153 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.774157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.774272 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.774297 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.774396 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.774489 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243}
I20260806 18:43:38.775486 7962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.770770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45213 (local address 127.12.177.131:60913)
0806 18:43:38.771350 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.771364 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:38.771491 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:38.771757 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:38.771760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:38.771777 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:38.771928 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.771935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.772717 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.772723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.773832 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:38.773843 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.775080 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.775083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:38.775156 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.775177 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 18:43:38.775243 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 18:43:38.775330 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":372,"thread_start_us":167,"threads_started":1}
I20260806 18:43:38.775553 7946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.770959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:60913 (local address 127.12.177.129:45213)
0806 18:43:38.771115 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.771122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.771469 (+ 347us) server_negotiation.cc:407] Connection header received
0806 18:43:38.771595 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.771599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.771656 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.771746 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:38.772070 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.772594 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.774119 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.774917 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.775062 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.775115 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.775315 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.775417 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:43:38.775969 7643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23860e8ac5df4fb4b52f5052054affe9" candidate_uuid: "a0b333c5bd3444f5907b304f4700d25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb3b8e171bd4762bae08164285a06e1" is_pre_election: true
I20260806 18:43:38.776190 7441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23860e8ac5df4fb4b52f5052054affe9" candidate_uuid: "a0b333c5bd3444f5907b304f4700d25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c60d68832aaf477eb4247e1fa81f46e1" is_pre_election: true
I20260806 18:43:38.776384 7643 raft_consensus.cc:2454] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0b333c5bd3444f5907b304f4700d25e in term 0.
I20260806 18:43:38.776535 7441 raft_consensus.cc:2454] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0b333c5bd3444f5907b304f4700d25e in term 0.
I20260806 18:43:38.777114 7741 leader_election.cc:302] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a0b333c5bd3444f5907b304f4700d25e, c60d68832aaf477eb4247e1fa81f46e1, eeb3b8e171bd4762bae08164285a06e1; no voters:
I20260806 18:43:38.777568 7959 raft_consensus.cc:2781] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:38.777688 7959 raft_consensus.cc:482] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:38.777761 7959 raft_consensus.cc:3037] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:38.778960 7959 raft_consensus.cc:504] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.779330 7959 leader_election.cc:288] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [CANDIDATE]: Term 1 election: Requested vote from peers eeb3b8e171bd4762bae08164285a06e1 (127.12.177.130:35003), c60d68832aaf477eb4247e1fa81f46e1 (127.12.177.129:45213)
I20260806 18:43:38.779834 7441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23860e8ac5df4fb4b52f5052054affe9" candidate_uuid: "a0b333c5bd3444f5907b304f4700d25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c60d68832aaf477eb4247e1fa81f46e1"
I20260806 18:43:38.779862 7643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23860e8ac5df4fb4b52f5052054affe9" candidate_uuid: "a0b333c5bd3444f5907b304f4700d25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb3b8e171bd4762bae08164285a06e1"
I20260806 18:43:38.780007 7643 raft_consensus.cc:3037] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:38.780007 7441 raft_consensus.cc:3037] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:38.781569 7441 raft_consensus.cc:2454] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0b333c5bd3444f5907b304f4700d25e in term 1.
I20260806 18:43:38.781569 7643 raft_consensus.cc:2454] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0b333c5bd3444f5907b304f4700d25e in term 1.
I20260806 18:43:38.782027 7741 leader_election.cc:302] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b333c5bd3444f5907b304f4700d25e, c60d68832aaf477eb4247e1fa81f46e1; no voters:
I20260806 18:43:38.782400 7959 raft_consensus.cc:2781] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:38.782725 7959 raft_consensus.cc:686] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 1 LEADER]: Becoming Leader. State: Replica: a0b333c5bd3444f5907b304f4700d25e, State: Running, Role: LEADER
I20260806 18:43:38.783159 7959 consensus_queue.cc:237] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } }
I20260806 18:43:38.787130 7196 catalog_manager.cc:5495] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e reported cstate change: term changed from 0 to 1, leader changed from <none> to a0b333c5bd3444f5907b304f4700d25e (127.12.177.131). New cstate: current_term: 1 leader_uuid: "a0b333c5bd3444f5907b304f4700d25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b333c5bd3444f5907b304f4700d25e" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 41211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 } health_report { overall_health: UNKNOWN } } }
W20260806 18:43:38.824196 7919 tablet.cc:2369] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:38.825744 7943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.821099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.12.177.131:41211)
0806 18:43:38.821244 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:38.821249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:38.821262 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:43:38.821415 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:38.821420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:38.821535 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:38.821682 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:38.822065 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.822913 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.823932 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:38.824183 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:38.824287 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:38.824813 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:38.825293 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:38.825470 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:38.825553 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 18:43:38.825621 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 18:43:38.834050 7643 raft_consensus.cc:1261] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 1 FOLLOWER]: Refusing update from remote peer a0b333c5bd3444f5907b304f4700d25e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:38.834050 7441 raft_consensus.cc:1261] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 1 FOLLOWER]: Refusing update from remote peer a0b333c5bd3444f5907b304f4700d25e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:38.835124 7963 consensus_queue.cc:1035] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb3b8e171bd4762bae08164285a06e1" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:38.835444 7959 consensus_queue.cc:1035] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c60d68832aaf477eb4247e1fa81f46e1" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 18:43:38.839573 7717 tablet.cc:2369] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:38.847590 7969 mvcc.cc:205] Tried to move back new op lower bound from 7315627289932931072 to 7315627289739276288. Current Snapshot: MvccSnapshot[applied={T|T < 7315627289932931072}]
I20260806 18:43:38.847779 7968 mvcc.cc:205] Tried to move back new op lower bound from 7315627289932931072 to 7315627289739276288. Current Snapshot: MvccSnapshot[applied={T|T < 7315627289932931072}]
I20260806 18:43:38.859263 7199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:38.859535 7199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:38.863041 7199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0646e3419e8448939397b15035df2bbd: Sending DeleteTablet for 3 replicas of tablet 23860e8ac5df4fb4b52f5052054affe9
I20260806 18:43:38.864194 7609 tablet_service.cc:1514] Processing DeleteTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:38 UTC) from {username='slave'} at 127.0.0.1:49286
I20260806 18:43:38.864249 7826 tablet_service.cc:1514] Processing DeleteTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:38 UTC) from {username='slave'} at 127.0.0.1:42980
I20260806 18:43:38.864238 7403 tablet_service.cc:1514] Processing DeleteTablet for tablet 23860e8ac5df4fb4b52f5052054affe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:38 UTC) from {username='slave'} at 127.0.0.1:59834
I20260806 18:43:38.864890 7984 tablet_replica.cc:330] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: stopping tablet replica
I20260806 18:43:38.865011 7986 tablet_replica.cc:330] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: stopping tablet replica
I20260806 18:43:38.865502 7984 raft_consensus.cc:2229] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:38.865568 7985 tablet_replica.cc:330] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1: stopping tablet replica
I20260806 18:43:38.865816 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 7303
I20260806 18:43:38.865903 7985 raft_consensus.cc:2229] T 23860e8ac5df4fb4b52f5052054affe9 P c60d68832aaf477eb4247e1fa81f46e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:38.868974 7984 raft_consensus.cc:2258] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:38.869729 7986 raft_consensus.cc:2229] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:43:38.870487 7986 raft_consensus.cc:2258] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:38.874126 7986 ts_tablet_manager.cc:1905] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:38.874140 7984 ts_tablet_manager.cc:1905] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:38.879287 7984 ts_tablet_manager.cc:1918] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:38.879467 7984 log.cc:1196] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/23860e8ac5df4fb4b52f5052054affe9
I20260806 18:43:38.879928 7984 ts_tablet_manager.cc:1939] T 23860e8ac5df4fb4b52f5052054affe9 P eeb3b8e171bd4762bae08164285a06e1: Deleting consensus metadata
I20260806 18:43:38.885245 7181 catalog_manager.cc:4841] TS eeb3b8e171bd4762bae08164285a06e1 (127.12.177.130:35003): tablet 23860e8ac5df4fb4b52f5052054affe9 (table test-table [id=d3a8229d004548a4a649ad710442af04]) successfully deleted
I20260806 18:43:38.885640 7986 ts_tablet_manager.cc:1918] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:38.885794 7986 log.cc:1196] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/23860e8ac5df4fb4b52f5052054affe9
I20260806 18:43:38.886201 7986 ts_tablet_manager.cc:1939] T 23860e8ac5df4fb4b52f5052054affe9 P a0b333c5bd3444f5907b304f4700d25e: Deleting consensus metadata
I20260806 18:43:38.888238 7180 catalog_manager.cc:4841] TS a0b333c5bd3444f5907b304f4700d25e (127.12.177.131:41211): tablet 23860e8ac5df4fb4b52f5052054affe9 (table test-table [id=d3a8229d004548a4a649ad710442af04]) successfully deleted
W20260806 18:43:38.890509 7179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:45213 (error 108)
I20260806 18:43:38.890601 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 7516
I20260806 18:43:38.894891 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:38.894460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45213 (local address 127.0.0.1:59838)
0806 18:43:38.894643 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:38.894762 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 18:43:38.895133 7179 catalog_manager.cc:4584] TS c60d68832aaf477eb4247e1fa81f46e1 (127.12.177.129:45213): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23860e8ac5df4fb4b52f5052054affe9: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45213: connect: Connection refused (error 111)
I20260806 18:43:38.918211 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 7719
I20260806 18:43:38.937304 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 7157
2026-08-06T18:43:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1388 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:39 dist-test-slave-j2vl krb5kdc[7993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:39 dist-test-slave-j2vl krb5kdc[7993](info): set up 2 sockets
Aug 06 18:43:39 dist-test-slave-j2vl krb5kdc[7993](info): commencing operation
krb5kdc: starting...
W20260806 18:43:40.243281 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:40 dist-test-slave-j2vl krb5kdc[7993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:43:40.411229 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:39093
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:39093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:40.553483 8009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:40.553874 8009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:40.553960 8009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:40.559221 8009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:40.559381 8009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:40.559427 8009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:40.559486 8009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:40.559535 8009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:40.566378 8009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:39093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:39093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:40.568056 8009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:40.569499 8009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:40.580276 8017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:40.580277 8018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:40.580322 8021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:40.580423 8009 server_base.cc:1034] running on GCE node
I20260806 18:43:40.581270 8009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:40.582630 8009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:40.583902 8009 hybrid_clock.cc:648] HybridClock initialized: now 1786041820583893 us; error 69 us; skew 500 ppm
Aug 06 18:43:40 dist-test-slave-j2vl krb5kdc[7993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041820, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:40.592607 8009 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:43:40.593927 8009 webserver.cc:460] Webserver started at http://127.12.177.190:38859/ using document root <none> and password file <none>
I20260806 18:43:40.594631 8009 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:40.594777 8009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:40.595057 8009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:40.597721 8009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "22677c410ec54745966e776c2649a4e5"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "731801ff797150607d709f04dec62941"
server_key_iv: "e201de660d4e999f0dbb28b601b3d1ef"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.598433 8009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "22677c410ec54745966e776c2649a4e5"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "731801ff797150607d709f04dec62941"
server_key_iv: "e201de660d4e999f0dbb28b601b3d1ef"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.603297 8009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:40.606920 8032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:40.608582 8009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:43:40.608786 8009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "22677c410ec54745966e776c2649a4e5"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "731801ff797150607d709f04dec62941"
server_key_iv: "e201de660d4e999f0dbb28b601b3d1ef"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.608963 8009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:40.623112 8009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:40.628016 8009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:40.628283 8009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:40.637285 8009 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:39093
I20260806 18:43:40.637305 8114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:39093 every 8 connection(s)
I20260806 18:43:40.638711 8009 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:40.641983 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8009
I20260806 18:43:40.642165 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:40.642750 12998 external_mini_cluster.cc:1428] Setting key 59322bd5535b7a4a575ab52ef4ec036b
I20260806 18:43:40.643266 8116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:40.654434 8116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: Bootstrap starting.
I20260806 18:43:40.657805 8116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: Neither blocks nor log segments found. Creating new log.
Aug 06 18:43:40 dist-test-slave-j2vl krb5kdc[7993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:40.658804 8116 log.cc:824] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:40.661895 8116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: No bootstrap required, opened a new log
I20260806 18:43:40.664662 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:40.645250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.12.177.190:39093)
0806 18:43:40.646016 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:40.646044 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:40.649867 (+ 3823us) server_negotiation.cc:407] Connection header received
0806 18:43:40.650779 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:40.650801 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:40.651248 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:40.651688 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:40.652733 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.653905 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.655072 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.655640 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.655854 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:40.659022 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:40.659029 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:40.659046 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:40.659085 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:40.661235 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:40.661857 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:40.661863 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:40.661871 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:40.662079 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:40.662430 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:40.662433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:40.662435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:40.662913 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:40.663138 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:40.663482 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 18:43:40.663842 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":242,"threads_started":1}
I20260806 18:43:40.666108 8116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } }
I20260806 18:43:40.666401 8116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:40.666486 8116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22677c410ec54745966e776c2649a4e5, State: Initialized, Role: FOLLOWER
I20260806 18:43:40.667177 8116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } }
I20260806 18:43:40.667373 8116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:40.667452 8116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:40.667634 8116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:40.668831 8116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } }
I20260806 18:43:40.669239 8116 leader_election.cc:302] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22677c410ec54745966e776c2649a4e5; no voters:
I20260806 18:43:40.669816 8116 leader_election.cc:288] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:40.669982 8129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:40.670394 8129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 22677c410ec54745966e776c2649a4e5, State: Running, Role: LEADER
I20260806 18:43:40.670794 8129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } }
I20260806 18:43:40.671478 8116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:40.672610 8133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22677c410ec54745966e776c2649a4e5. Latest consensus state: current_term: 1 leader_uuid: "22677c410ec54745966e776c2649a4e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } } }
I20260806 18:43:40.672765 8133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:40.673216 8141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:40.673177 8130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22677c410ec54745966e776c2649a4e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22677c410ec54745966e776c2649a4e5" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 39093 } } }
I20260806 18:43:40.673475 8130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:40.677165 8141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:40.683899 8141 catalog_manager.cc:1347] Generated new cluster ID: c237df64d6a043a5bbe1192c9fd74bfc
I20260806 18:43:40.684103 8141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:40.702677 8141 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:40.704059 8141 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:40.715195 8141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: Generated new TSK 0
I20260806 18:43:40.716257 8141 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:43:40.754103 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:40.895944 8157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:40.896288 8157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:40.896348 8157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:40.900768 8157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:40.900874 8157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:40.900942 8157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:40.907127 8157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:40.908361 8157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:40.909895 8157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:40.921253 8167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:40.921275 8171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:40.921288 8165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:40.921599 8157 server_base.cc:1034] running on GCE node
I20260806 18:43:40.922142 8157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:40.922895 8157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:40.924170 8157 hybrid_clock.cc:648] HybridClock initialized: now 1786041820924135 us; error 49 us; skew 500 ppm
Aug 06 18:43:40 dist-test-slave-j2vl krb5kdc[7993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041820, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:40.927980 8157 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:43:40.929250 8157 webserver.cc:460] Webserver started at http://127.12.177.129:38259/ using document root <none> and password file <none>
I20260806 18:43:40.929963 8157 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:40.930075 8157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:40.930344 8157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:40.932710 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "13eb08009e8748c9ae88eaef8c380c95"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "0739356f5d3521728bcd1b23eedba6a4"
server_key_iv: "9f4341b51ec9534e369c1514041217a4"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.933447 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "13eb08009e8748c9ae88eaef8c380c95"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "0739356f5d3521728bcd1b23eedba6a4"
server_key_iv: "9f4341b51ec9534e369c1514041217a4"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.937743 8157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:43:40.940584 8180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:40.942060 8157 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:40.942198 8157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "13eb08009e8748c9ae88eaef8c380c95"
format_stamp: "Formatted at 2026-08-06 18:43:40 on dist-test-slave-j2vl"
server_key: "0739356f5d3521728bcd1b23eedba6a4"
server_key_iv: "9f4341b51ec9534e369c1514041217a4"
server_key_version: "encryptionkey@0"
I20260806 18:43:40.942327 8157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:40.962901 8157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:40.967018 8157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:40.967217 8157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:40.967873 8157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:40.968839 8157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:40.968899 8157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:40.968945 8157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:40.968959 8157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:40.979632 8157 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:45791
I20260806 18:43:40.979656 8348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:45791 every 8 connection(s)
I20260806 18:43:40.980672 8157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:40.985224 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8157
I20260806 18:43:40.985443 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:40.985801 12998 external_mini_cluster.cc:1428] Setting key 2d131f45771f0b58a1e73109c4f18c8e
Aug 06 18:43:40 dist-test-slave-j2vl krb5kdc[7993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041820, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:40.998526 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:40.982925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:55629 (local address 127.12.177.190:39093)
0806 18:43:40.983089 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:40.983094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:40.984066 (+ 972us) server_negotiation.cc:407] Connection header received
0806 18:43:40.985622 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:40.985627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:40.985697 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:40.985816 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:40.987629 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.988438 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.989982 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.990355 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.990470 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:40.993936 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:40.993939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:40.993941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:40.993969 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:40.995725 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:40.996515 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:40.996519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:40.996520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:40.996613 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:40.997105 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:40.997108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:40.997109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:40.997324 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:40.997487 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:40.998238 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 18:43:40.998378 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:43:40.999945 8352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:40.983399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39093 (local address 127.12.177.129:55629)
0806 18:43:40.983899 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:40.983946 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:40.985266 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:40.986100 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:40.986107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:40.986652 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:40.987429 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:40.987454 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.988617 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.988620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:40.989817 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:40.989834 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:40.990540 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:40.990546 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:40.990793 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:40.991560 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:40.991589 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:40.993734 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:40.995866 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:40.995878 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:40.995901 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:40.996345 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:40.996728 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:40.996734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:40.996739 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:40.996974 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:40.997500 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:40.997508 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:40.997932 (+ 424us) client_negotiation.cc:769] Sending connection context
0806 18:43:40.998175 (+ 243us) client_negotiation.cc:240] Negotiation successful
0806 18:43:40.998636 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:43:41.002156 8350 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39093
I20260806 18:43:41.002434 8350 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:41.003016 8350 heartbeater.cc:511] Master 127.12.177.190:39093 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:43:41.005146 8061 ts_manager.cc:194] Registered new tserver with Master: 13eb08009e8748c9ae88eaef8c380c95 (127.12.177.129:45791)
I20260806 18:43:41.006474 8061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:55629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:43:41.032369 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:41.170105 8358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:41.170451 8358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:41.170508 8358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:41.175319 8358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:41.175405 8358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:41.175504 8358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:41.181561 8358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:41.182946 8358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:41.184294 8358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:41.196355 8367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:41.196360 8370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:41.196692 8358 server_base.cc:1034] running on GCE node
W20260806 18:43:41.196406 8366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:41.197295 8358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:41.198331 8358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:41.199605 8358 hybrid_clock.cc:648] HybridClock initialized: now 1786041821199559 us; error 76 us; skew 500 ppm
Aug 06 18:43:41 dist-test-slave-j2vl krb5kdc[7993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:41.203325 8358 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:43:41.204495 8358 webserver.cc:460] Webserver started at http://127.12.177.130:36247/ using document root <none> and password file <none>
I20260806 18:43:41.205174 8358 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:41.205247 8358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:41.205533 8358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:41.207986 8358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "3b25c6a6881f4e2c88922f90b7345119"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "b6bd2702ae4dd1a0cce79b762188efaa"
server_key_iv: "6f834899dd16df57447f9d24b5563121"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.208702 8358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "3b25c6a6881f4e2c88922f90b7345119"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "b6bd2702ae4dd1a0cce79b762188efaa"
server_key_iv: "6f834899dd16df57447f9d24b5563121"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.214449 8358 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 18:43:41.217742 8381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.219736 8358 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 18:43:41.219909 8358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "3b25c6a6881f4e2c88922f90b7345119"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "b6bd2702ae4dd1a0cce79b762188efaa"
server_key_iv: "6f834899dd16df57447f9d24b5563121"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.220129 8358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:41.255712 8358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:41.260833 8358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:41.261037 8358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:41.261798 8358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:41.262742 8358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:41.262805 8358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.262854 8358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:41.262869 8358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.273988 8358 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:39349
I20260806 18:43:41.274026 8552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:39349 every 8 connection(s)
I20260806 18:43:41.275092 8358 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:41.285125 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8358
I20260806 18:43:41.285279 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:41.285636 12998 external_mini_cluster.cc:1428] Setting key 9c970d288467fb8ae6cdb15c0ba2c580
Aug 06 18:43:41 dist-test-slave-j2vl krb5kdc[7993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:41.291764 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.277444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:44831 (local address 127.12.177.190:39093)
0806 18:43:41.277614 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.277618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.278652 (+ 1034us) server_negotiation.cc:407] Connection header received
0806 18:43:41.280118 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.280121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.280177 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.280264 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:41.281813 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.282377 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.283773 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.284022 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.284120 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.287345 (+ 3225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:41.287349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:41.287351 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:41.287377 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:41.288958 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.289647 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.289650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.289651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.289732 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.290479 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.290482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.290483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.290687 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:41.290808 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.291418 (+ 610us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.291588 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 18:43:41.292716 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.277911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39093 (local address 127.12.177.130:44831)
0806 18:43:41.278473 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.278523 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.279850 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.280471 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.280479 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.280901 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:41.281578 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.281598 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.282605 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.282609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.283617 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.283629 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.284199 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.284202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.284372 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.285046 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:41.285073 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:41.287139 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:41.289106 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:41.289113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:41.289133 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:41.289523 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:41.289832 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:41.289835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:41.289837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:41.290017 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:41.290811 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:41.290822 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:41.291141 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.291353 (+ 212us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.291752 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":143,"threads_started":1}
I20260806 18:43:41.294214 8554 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39093
I20260806 18:43:41.294516 8554 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:41.295122 8554 heartbeater.cc:511] Master 127.12.177.190:39093 requested a full tablet report, sending...
I20260806 18:43:41.296427 8061 ts_manager.cc:194] Registered new tserver with Master: 3b25c6a6881f4e2c88922f90b7345119 (127.12.177.130:39349)
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
I20260806 18:43:41.297334 8061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:44831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:43:41.325335 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:33237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:41.450107 8567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:41.450433 8567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:41.450484 8567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:41.454941 8567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:41.455029 8567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:41.455130 8567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:41.461477 8567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:33237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:39093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:41.462814 8567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:41.463954 8567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:41.475238 8576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:41.475281 8580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:41.475576 8567 server_base.cc:1034] running on GCE node
W20260806 18:43:41.475238 8578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:41.476148 8567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:41.477078 8567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:41.478260 8567 hybrid_clock.cc:648] HybridClock initialized: now 1786041821478240 us; error 47 us; skew 500 ppm
Aug 06 18:43:41 dist-test-slave-j2vl krb5kdc[7993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:41.481592 8567 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:43:41.482728 8567 webserver.cc:460] Webserver started at http://127.12.177.131:43023/ using document root <none> and password file <none>
I20260806 18:43:41.483384 8567 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:41.483500 8567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:41.483767 8567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:41.486181 8567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "3e2eb9b984474410a06dd2e3f887939f"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "9919c91cc19fb6357002f0b2b613be4b"
server_key_iv: "1fe29906db1d011ca5ac8ddebb214fe3"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.486840 8567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "3e2eb9b984474410a06dd2e3f887939f"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "9919c91cc19fb6357002f0b2b613be4b"
server_key_iv: "1fe29906db1d011ca5ac8ddebb214fe3"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.491313 8567 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:41.494225 8588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.495721 8567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:41.495895 8567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "3e2eb9b984474410a06dd2e3f887939f"
format_stamp: "Formatted at 2026-08-06 18:43:41 on dist-test-slave-j2vl"
server_key: "9919c91cc19fb6357002f0b2b613be4b"
server_key_iv: "1fe29906db1d011ca5ac8ddebb214fe3"
server_key_version: "encryptionkey@0"
I20260806 18:43:41.496042 8567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:41.515209 8567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:41.518996 8567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:41.519235 8567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:41.519928 8567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:41.520869 8567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:41.520942 8567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.521018 8567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:41.521067 8567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:41.531853 8567 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:35311
I20260806 18:43:41.531876 8767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:35311 every 8 connection(s)
I20260806 18:43:41.532919 8567 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:41.534929 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8567
I20260806 18:43:41.535089 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:41.535493 12998 external_mini_cluster.cc:1428] Setting key b333e336ebb59c1f5a28da989c399461
Aug 06 18:43:41 dist-test-slave-j2vl krb5kdc[7993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:41.550100 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.535399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:50301 (local address 127.12.177.190:39093)
0806 18:43:41.535578 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.535583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.537143 (+ 1560us) server_negotiation.cc:407] Connection header received
0806 18:43:41.538494 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.538496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.538548 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.538622 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:41.540024 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.540573 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.542031 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.542258 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.542358 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.545288 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:41.545291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:41.545293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:41.545323 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:41.546970 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.547740 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.547745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.547747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.547856 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.548332 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.548336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.548338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.548613 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:41.548752 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.549786 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.549966 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 18:43:41.551196 8771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.535886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:39093 (local address 127.12.177.131:50301)
0806 18:43:41.536965 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.537041 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.538258 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.538801 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.538809 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.539237 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:41.539852 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.539869 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.540715 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.540719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.541893 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.541907 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.542476 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.542479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.542657 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.543305 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:41.543325 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:41.545066 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:41.547132 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:41.547140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:41.547165 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:41.547574 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:41.547990 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:41.547993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:41.547994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:41.548206 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:41.548765 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:41.548771 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:41.549246 (+ 475us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.549637 (+ 391us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.550089 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":602,"threads_started":1}
I20260806 18:43:41.553004 8768 heartbeater.cc:347] Connected to a master server at 127.12.177.190:39093
I20260806 18:43:41.553323 8768 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:41.553985 8768 heartbeater.cc:511] Master 127.12.177.190:39093 requested a full tablet report, sending...
I20260806 18:43:41.555254 8061 ts_manager.cc:194] Registered new tserver with Master: 3e2eb9b984474410a06dd2e3f887939f (127.12.177.131:35311)
I20260806 18:43:41.555943 8061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:50301
I20260806 18:43:41.563360 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:41.575196 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.565967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.12.177.190:39093)
0806 18:43:41.566120 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.566125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.566389 (+ 264us) server_negotiation.cc:407] Connection header received
0806 18:43:41.566451 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.566454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.566504 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.566592 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:41.567429 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.568018 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.568986 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.569219 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.569311 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.571295 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:41.571299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:41.571301 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:41.571334 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:41.573295 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.573925 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.573928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.573929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.574022 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:41.574331 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:41.574334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:41.574335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:41.574577 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:41.574705 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.574959 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.575054 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:43:41.579140 8061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:41.582700 8061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:41.601864 8788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.594524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.12.177.129:45791)
0806 18:43:41.595308 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.595316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.595341 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:43:41.595427 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.595432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.595616 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.595918 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:41.596338 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597569 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.599694 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.600664 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.600815 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.600995 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.601542 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.601672 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":82,"threads_started":1}
I20260806 18:43:41.601852 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.594012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45791 (local address 127.0.0.1:59482)
0806 18:43:41.594997 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.595008 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.595095 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.595802 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.595805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.595842 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:41.596193 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.596201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597709 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.597712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.599509 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.599525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.601074 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.601078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.601254 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.601292 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.601488 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.601672 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":363,"spinlock_wait_cycles":7808,"thread_start_us":131,"threads_started":1}
I20260806 18:43:41.602451 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.593560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:39349 (local address 127.0.0.1:41782)
0806 18:43:41.594509 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.594576 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.594765 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.596191 (+ 1426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.596195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.596310 (+ 115us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:41.596443 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.596452 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597953 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.597959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.599518 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.599530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.601185 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.601189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.601369 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.601430 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.601511 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.602312 (+ 801us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":789,"thread_start_us":123,"threads_started":1}
I20260806 18:43:41.602852 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.593648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:35311 (local address 127.0.0.1:38468)
0806 18:43:41.594658 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.594670 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.594765 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.595789 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.595797 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.595841 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:41.596027 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.596039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597429 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.597432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.599509 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.599525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.600996 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.601000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.601384 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.601430 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.601511 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.602711 (+ 1200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":1307,"spinlock_wait_cycles":4736,"thread_start_us":135,"threads_started":1}
I20260806 18:43:41.601933 8790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.594549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38468 (local address 127.12.177.131:35311)
0806 18:43:41.594975 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.594989 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.595018 (+ 29us) server_negotiation.cc:407] Connection header received
0806 18:43:41.595115 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.595121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.595388 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.595564 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:41.596194 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597223 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.599695 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.600863 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.600994 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.601122 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.601663 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.601774 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":193,"threads_started":1}
I20260806 18:43:41.603111 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.593654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41782 (local address 127.12.177.130:39349)
0806 18:43:41.595378 (+ 1724us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.595392 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.595416 (+ 24us) server_negotiation.cc:407] Connection header received
0806 18:43:41.595500 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.595505 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.595787 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.595963 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:41.596608 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.597802 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.599658 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.600730 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.600940 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.601115 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.601644 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.602925 (+ 1281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1605,"thread_start_us":161,"threads_started":1}
I20260806 18:43:41.605834 8253 tablet_service.cc:1467] Processing CreateTablet for tablet b8c5767b92994349aca8a78b04cb65fb (DEFAULT_TABLE table=test-table [id=224dddf491ef4a2880e8be789c5c209d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:41.605847 8661 tablet_service.cc:1467] Processing CreateTablet for tablet b8c5767b92994349aca8a78b04cb65fb (DEFAULT_TABLE table=test-table [id=224dddf491ef4a2880e8be789c5c209d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:41.607191 8661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c5767b92994349aca8a78b04cb65fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:41.607191 8253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c5767b92994349aca8a78b04cb65fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:41.611821 8454 tablet_service.cc:1467] Processing CreateTablet for tablet b8c5767b92994349aca8a78b04cb65fb (DEFAULT_TABLE table=test-table [id=224dddf491ef4a2880e8be789c5c209d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:41.613070 8454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c5767b92994349aca8a78b04cb65fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:41.616129 8796 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Bootstrap starting.
I20260806 18:43:41.616626 8791 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Bootstrap starting.
I20260806 18:43:41.619383 8791 tablet_bootstrap.cc:654] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:41.620404 8791 log.cc:824] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:41.622495 8798 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Bootstrap starting.
I20260806 18:43:41.623277 8791 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: No bootstrap required, opened a new log
I20260806 18:43:41.623554 8791 ts_tablet_manager.cc:1397] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260806 18:43:41.623646 8796 tablet_bootstrap.cc:654] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:41.625123 8798 tablet_bootstrap.cc:654] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:41.625154 8796 log.cc:824] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:41.626619 8798 log.cc:824] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:41.627753 8796 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: No bootstrap required, opened a new log
I20260806 18:43:41.627995 8796 ts_tablet_manager.cc:1397] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260806 18:43:41.628587 8791 raft_consensus.cc:348] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.628892 8791 raft_consensus.cc:374] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:41.628949 8791 raft_consensus.cc:729] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13eb08009e8748c9ae88eaef8c380c95, State: Initialized, Role: FOLLOWER
I20260806 18:43:41.628983 8798 tablet_bootstrap.cc:492] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: No bootstrap required, opened a new log
I20260806 18:43:41.629197 8798 ts_tablet_manager.cc:1397] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 18:43:41.629510 8791 consensus_queue.cc:260] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.630340 8350 heartbeater.cc:503] Master 127.12.177.190:39093 was elected leader, sending a full tablet report...
I20260806 18:43:41.630836 8791 ts_tablet_manager.cc:1428] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 18:43:41.632383 8796 raft_consensus.cc:348] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.632725 8796 raft_consensus.cc:374] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:41.632800 8796 raft_consensus.cc:729] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2eb9b984474410a06dd2e3f887939f, State: Initialized, Role: FOLLOWER
I20260806 18:43:41.633335 8796 consensus_queue.cc:260] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.634678 8796 ts_tablet_manager.cc:1428] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:43:41.635130 8768 heartbeater.cc:503] Master 127.12.177.190:39093 was elected leader, sending a full tablet report...
I20260806 18:43:41.634934 8798 raft_consensus.cc:348] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.635258 8798 raft_consensus.cc:374] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:41.635335 8798 raft_consensus.cc:729] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b25c6a6881f4e2c88922f90b7345119, State: Initialized, Role: FOLLOWER
I20260806 18:43:41.635845 8798 consensus_queue.cc:260] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.636863 8554 heartbeater.cc:503] Master 127.12.177.190:39093 was elected leader, sending a full tablet report...
I20260806 18:43:41.637066 8798 ts_tablet_manager.cc:1428] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260806 18:43:41.732661 8351 tablet.cc:2369] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:43:41.776484 8555 tablet.cc:2369] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 18:43:41.784216 8770 tablet.cc:2369] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:41.861409 8807 raft_consensus.cc:482] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:41.861675 8807 raft_consensus.cc:504] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.863176 8807 leader_election.cc:288] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b25c6a6881f4e2c88922f90b7345119 (127.12.177.130:39349), 13eb08009e8748c9ae88eaef8c380c95 (127.12.177.129:45791)
I20260806 18:43:41.868422 8771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.863476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:39349 (local address 127.12.177.131:54305)
0806 18:43:41.863642 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.863663 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.863827 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.864515 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.864519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.864562 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:41.864806 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.864818 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.866100 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.866103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.867011 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.867023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.867801 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.867994 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.868021 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.868090 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.868232 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":45}
I20260806 18:43:41.868556 8788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.863960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:44611 (local address 127.12.177.129:45791)
0806 18:43:41.864113 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.864120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.864499 (+ 379us) server_negotiation.cc:407] Connection header received
0806 18:43:41.864586 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.864590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.864776 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.864880 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:41.865426 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.865926 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867187 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.867649 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867803 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.867867 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.868314 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.868416 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 18:43:41.868616 8811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.863701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45791 (local address 127.12.177.131:44611)
0806 18:43:41.864325 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.864343 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:41.864468 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:41.864977 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:41.864980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:41.865002 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:41.865170 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.865177 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.866071 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.866075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.867015 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:41.867027 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.867817 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:41.867996 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.868026 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 18:43:41.868267 (+ 241us) client_negotiation.cc:240] Negotiation successful
0806 18:43:41.868462 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":39,"thread_start_us":171,"threads_started":1}
I20260806 18:43:41.868599 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.863945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:54305 (local address 127.12.177.130:39349)
0806 18:43:41.864135 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.864140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.864159 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:43:41.864230 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.864233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.864295 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.864413 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:41.864985 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.865906 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867182 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.867631 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.867801 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.867867 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.868192 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.868436 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 18:43:41.869494 8479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c5767b92994349aca8a78b04cb65fb" candidate_uuid: "3e2eb9b984474410a06dd2e3f887939f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b25c6a6881f4e2c88922f90b7345119" is_pre_election: true
I20260806 18:43:41.869495 8279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c5767b92994349aca8a78b04cb65fb" candidate_uuid: "3e2eb9b984474410a06dd2e3f887939f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13eb08009e8748c9ae88eaef8c380c95" is_pre_election: true
I20260806 18:43:41.869911 8279 raft_consensus.cc:2454] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2eb9b984474410a06dd2e3f887939f in term 0.
I20260806 18:43:41.869911 8479 raft_consensus.cc:2454] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2eb9b984474410a06dd2e3f887939f in term 0.
I20260806 18:43:41.870633 8589 leader_election.cc:302] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b25c6a6881f4e2c88922f90b7345119, 3e2eb9b984474410a06dd2e3f887939f; no voters:
I20260806 18:43:41.871016 8807 raft_consensus.cc:2781] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:41.871178 8807 raft_consensus.cc:482] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:41.871230 8807 raft_consensus.cc:3037] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:41.872581 8807 raft_consensus.cc:504] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.873092 8807 leader_election.cc:288] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [CANDIDATE]: Term 1 election: Requested vote from peers 3b25c6a6881f4e2c88922f90b7345119 (127.12.177.130:39349), 13eb08009e8748c9ae88eaef8c380c95 (127.12.177.129:45791)
I20260806 18:43:41.873751 8279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c5767b92994349aca8a78b04cb65fb" candidate_uuid: "3e2eb9b984474410a06dd2e3f887939f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13eb08009e8748c9ae88eaef8c380c95"
I20260806 18:43:41.873912 8479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c5767b92994349aca8a78b04cb65fb" candidate_uuid: "3e2eb9b984474410a06dd2e3f887939f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b25c6a6881f4e2c88922f90b7345119"
I20260806 18:43:41.873982 8279 raft_consensus.cc:3037] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:41.874094 8479 raft_consensus.cc:3037] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:41.875375 8279 raft_consensus.cc:2454] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2eb9b984474410a06dd2e3f887939f in term 1.
I20260806 18:43:41.875385 8479 raft_consensus.cc:2454] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2eb9b984474410a06dd2e3f887939f in term 1.
I20260806 18:43:41.875867 8589 leader_election.cc:302] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b25c6a6881f4e2c88922f90b7345119, 3e2eb9b984474410a06dd2e3f887939f; no voters:
I20260806 18:43:41.876119 8807 raft_consensus.cc:2781] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:41.876384 8807 raft_consensus.cc:686] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 1 LEADER]: Becoming Leader. State: Replica: 3e2eb9b984474410a06dd2e3f887939f, State: Running, Role: LEADER
I20260806 18:43:41.876858 8807 consensus_queue.cc:237] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } }
I20260806 18:43:41.881034 8061 catalog_manager.cc:5495] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2eb9b984474410a06dd2e3f887939f (127.12.177.131). New cstate: current_term: 1 leader_uuid: "3e2eb9b984474410a06dd2e3f887939f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2eb9b984474410a06dd2e3f887939f" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 35311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 } health_report { overall_health: UNKNOWN } } }
I20260806 18:43:41.902007 8790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.897619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38478 (local address 127.12.177.131:35311)
0806 18:43:41.897803 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:41.897808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:41.897912 (+ 104us) server_negotiation.cc:407] Connection header received
0806 18:43:41.898146 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:41.898148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:41.898214 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:41.898366 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:41.898660 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.899186 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.900141 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:41.900405 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:41.900523 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:41.900897 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:41.901449 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:41.901629 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:41.901763 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 18:43:41.901813 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 18:43:41.909056 8279 raft_consensus.cc:1261] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 1 FOLLOWER]: Refusing update from remote peer 3e2eb9b984474410a06dd2e3f887939f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:41.909056 8479 raft_consensus.cc:1261] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 1 FOLLOWER]: Refusing update from remote peer 3e2eb9b984474410a06dd2e3f887939f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:41.909971 8807 consensus_queue.cc:1035] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b25c6a6881f4e2c88922f90b7345119" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:41.910210 8812 consensus_queue.cc:1035] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [LEADER]: Connected to new peer: Peer: permanent_uuid: "13eb08009e8748c9ae88eaef8c380c95" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:41.918696 8817 mvcc.cc:205] Tried to move back new op lower bound from 7315627302530822144 to 7315627302411804672. Current Snapshot: MvccSnapshot[applied={T|T < 7315627302530822144}]
I20260806 18:43:41.920444 8816 mvcc.cc:205] Tried to move back new op lower bound from 7315627302530822144 to 7315627302411804672. Current Snapshot: MvccSnapshot[applied={T|T < 7315627302530822144}]
I20260806 18:43:41.928836 8061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:41.929041 8061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:41.932229 8061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22677c410ec54745966e776c2649a4e5: Sending DeleteTablet for 3 replicas of tablet b8c5767b92994349aca8a78b04cb65fb
I20260806 18:43:41.933323 8454 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c5767b92994349aca8a78b04cb65fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:41 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:41782
I20260806 18:43:41.933403 8661 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c5767b92994349aca8a78b04cb65fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:41 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:38468
I20260806 18:43:41.933511 8253 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c5767b92994349aca8a78b04cb65fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:41 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:59482
I20260806 18:43:41.934127 8834 tablet_replica.cc:330] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95: stopping tablet replica
I20260806 18:43:41.934242 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8157
I20260806 18:43:41.934578 8834 raft_consensus.cc:2229] T b8c5767b92994349aca8a78b04cb65fb P 13eb08009e8748c9ae88eaef8c380c95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:41.935050 8833 tablet_replica.cc:330] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: stopping tablet replica
I20260806 18:43:41.935420 8833 raft_consensus.cc:2229] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:41.935906 8833 raft_consensus.cc:2258] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:41.936434 8832 tablet_replica.cc:330] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: stopping tablet replica
I20260806 18:43:41.936904 8832 raft_consensus.cc:2229] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:43:41.937440 8832 raft_consensus.cc:2258] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:41.946540 8832 ts_tablet_manager.cc:1905] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:41.950002 8832 ts_tablet_manager.cc:1918] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:41.950248 8832 log.cc:1196] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/b8c5767b92994349aca8a78b04cb65fb
I20260806 18:43:41.950759 8832 ts_tablet_manager.cc:1939] T b8c5767b92994349aca8a78b04cb65fb P 3e2eb9b984474410a06dd2e3f887939f: Deleting consensus metadata
I20260806 18:43:41.952399 8042 catalog_manager.cc:4841] TS 3e2eb9b984474410a06dd2e3f887939f (127.12.177.131:35311): tablet b8c5767b92994349aca8a78b04cb65fb (table test-table [id=224dddf491ef4a2880e8be789c5c209d]) successfully deleted
I20260806 18:43:41.954650 8833 ts_tablet_manager.cc:1905] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:41.957857 8833 ts_tablet_manager.cc:1918] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:41.958001 8833 log.cc:1196] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/b8c5767b92994349aca8a78b04cb65fb
I20260806 18:43:41.958400 8833 ts_tablet_manager.cc:1939] T b8c5767b92994349aca8a78b04cb65fb P 3b25c6a6881f4e2c88922f90b7345119: Deleting consensus metadata
W20260806 18:43:41.959602 8041 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:45791 (error 108)
I20260806 18:43:41.959905 8034 catalog_manager.cc:4841] TS 3b25c6a6881f4e2c88922f90b7345119 (127.12.177.130:39349): tablet b8c5767b92994349aca8a78b04cb65fb (table test-table [id=224dddf491ef4a2880e8be789c5c209d]) successfully deleted
I20260806 18:43:41.960660 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8358
I20260806 18:43:41.960968 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:41.960621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45791 (local address 127.0.0.1:59496)
0806 18:43:41.960787 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:41.960874 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 18:43:41.964570 8041 catalog_manager.cc:4584] TS 13eb08009e8748c9ae88eaef8c380c95 (127.12.177.129:45791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b8c5767b92994349aca8a78b04cb65fb: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45791: connect: Connection refused (error 111)
I20260806 18:43:41.971526 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8567
I20260806 18:43:41.985193 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8009
2026-08-06T18:43:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (3047 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T18:43:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:42Z Disabled control of system clock
I20260806 18:43:42.028462 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33533
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:33533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:42.160456 8841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:42.160816 8841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:42.160857 8841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:42.166392 8841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:42.166483 8841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:42.166500 8841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:42.166519 8841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:42.166536 8841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:42.172309 8841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:33533
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:42.173738 8841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:42.175364 8841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:42.185495 8849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.185488 8854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.185662 8841 server_base.cc:1034] running on GCE node
W20260806 18:43:42.185482 8851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.186604 8841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:42.187917 8841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:42.189143 8841 hybrid_clock.cc:648] HybridClock initialized: now 1786041822189117 us; error 46 us; skew 500 ppm
I20260806 18:43:42.191617 8841 webserver.cc:460] Webserver started at http://127.12.177.190:34641/ using document root <none> and password file <none>
I20260806 18:43:42.192325 8841 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:42.192440 8841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:42.192729 8841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:42.195261 8841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "e746db2c6a1840719c6382f4f571c7b4"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "c11c0ee41b40b5750268e2be2de1eb05"
server_key_iv: "cde642770290c1a47f5b9e28f1ef2b6e"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.195978 8841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "e746db2c6a1840719c6382f4f571c7b4"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "c11c0ee41b40b5750268e2be2de1eb05"
server_key_iv: "cde642770290c1a47f5b9e28f1ef2b6e"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.201179 8841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 18:43:42.204427 8863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.206368 8841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:42.206615 8841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "e746db2c6a1840719c6382f4f571c7b4"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "c11c0ee41b40b5750268e2be2de1eb05"
server_key_iv: "cde642770290c1a47f5b9e28f1ef2b6e"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.206786 8841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:42.222496 8841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:42.223742 8841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:42.224362 8841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:42.233232 8841 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:33533
I20260806 18:43:42.233235 8955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:33533 every 8 connection(s)
I20260806 18:43:42.234513 8841 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:42.237552 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8841
I20260806 18:43:42.237710 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:42.238031 12998 external_mini_cluster.cc:1428] Setting key eb3624ce316a9f5f2842c89407cbc12f
I20260806 18:43:42.238708 8957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:42.246687 8957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: Bootstrap starting.
I20260806 18:43:42.249435 8957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:42.250026 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.239819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.12.177.190:33533)
0806 18:43:42.240675 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:42.240952 (+ 277us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:42.241006 (+ 54us) server_negotiation.cc:407] Connection header received
0806 18:43:42.241907 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:42.241932 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:42.242445 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:42.242858 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:42.243376 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.244534 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.245691 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.246378 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.246624 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:42.247648 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:42.247653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:42.247669 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:42.248271 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:42.248357 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:42.248389 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:42.248549 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:42.248704 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 18:43:42.249017 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":204,"threads_started":1}
I20260806 18:43:42.250499 8957 log.cc:824] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:42.253562 8957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: No bootstrap required, opened a new log
I20260806 18:43:42.258067 8957 raft_consensus.cc:348] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } }
I20260806 18:43:42.258383 8957 raft_consensus.cc:374] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:42.258440 8957 raft_consensus.cc:729] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e746db2c6a1840719c6382f4f571c7b4, State: Initialized, Role: FOLLOWER
I20260806 18:43:42.258908 8957 consensus_queue.cc:260] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } }
I20260806 18:43:42.259089 8957 raft_consensus.cc:388] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:42.259194 8957 raft_consensus.cc:482] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:42.259338 8957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:42.260915 8957 raft_consensus.cc:504] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } }
I20260806 18:43:42.261773 8957 leader_election.cc:302] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e746db2c6a1840719c6382f4f571c7b4; no voters:
I20260806 18:43:42.262274 8957 leader_election.cc:288] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:42.262462 8967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:42.262778 8967 raft_consensus.cc:686] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [term 1 LEADER]: Becoming Leader. State: Replica: e746db2c6a1840719c6382f4f571c7b4, State: Running, Role: LEADER
I20260806 18:43:42.263418 8967 consensus_queue.cc:237] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } }
I20260806 18:43:42.263911 8957 sys_catalog.cc:564] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:42.265259 8970 sys_catalog.cc:455] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e746db2c6a1840719c6382f4f571c7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } } }
I20260806 18:43:42.265452 8970 sys_catalog.cc:458] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:42.265496 8969 sys_catalog.cc:455] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e746db2c6a1840719c6382f4f571c7b4. Latest consensus state: current_term: 1 leader_uuid: "e746db2c6a1840719c6382f4f571c7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e746db2c6a1840719c6382f4f571c7b4" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33533 } } }
I20260806 18:43:42.265565 8969 sys_catalog.cc:458] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:42.265908 8983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:42.269568 8983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:42.277379 8983 catalog_manager.cc:1347] Generated new cluster ID: 3d5e26124ef842149351ab7b832fa796
I20260806 18:43:42.277500 8983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:42.297859 8983 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:42.299340 8983 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:42.307386 8983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: Generated new TSK 0
I20260806 18:43:42.308435 8983 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:42.313325 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--builtin_ntp_servers=127.12.177.148:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:42.446930 8994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:42.447296 8994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:42.447369 8994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:42.451594 8994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:42.451710 8994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:42.451814 8994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:42.457063 8994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:42.458420 8994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:42.459981 8994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:42.474603 9001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.474800 9004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.474974 8994 server_base.cc:1034] running on GCE node
W20260806 18:43:42.474615 9000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.475708 8994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:42.476529 8994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:42.479843 8994 hybrid_clock.cc:648] HybridClock initialized: now 1786041822479811 us; error 37 us; skew 500 ppm
I20260806 18:43:42.482180 8994 webserver.cc:460] Webserver started at http://127.12.177.129:36815/ using document root <none> and password file <none>
I20260806 18:43:42.482862 8994 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:42.482964 8994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:42.483220 8994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:42.485706 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "16b9c18e7c6b40be87add00175e6e422"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "137b4409d36c53b77a9a7a5f39eba9f3"
server_key_iv: "7b7b5f82ad6a4ef349678d1d738676c2"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.486392 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "16b9c18e7c6b40be87add00175e6e422"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "137b4409d36c53b77a9a7a5f39eba9f3"
server_key_iv: "7b7b5f82ad6a4ef349678d1d738676c2"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.490764 8994 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 18:43:42.493855 9011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.495280 8994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:42.495493 8994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "16b9c18e7c6b40be87add00175e6e422"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "137b4409d36c53b77a9a7a5f39eba9f3"
server_key_iv: "7b7b5f82ad6a4ef349678d1d738676c2"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.495641 8994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:42.525169 8994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:42.526296 8994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:42.526548 8994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:42.527356 8994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:42.528538 8994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:42.528620 8994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.528694 8994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:42.528739 8994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.540961 8994 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:35613
I20260806 18:43:42.540997 9193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:35613 every 8 connection(s)
I20260806 18:43:42.542172 8994 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:42.543294 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 8994
I20260806 18:43:42.543416 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:42.543730 12998 external_mini_cluster.cc:1428] Setting key 39516e23f946799d50b0507513c183d9
I20260806 18:43:42.546377 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--builtin_ntp_servers=127.12.177.148:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:42.553823 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.544659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:49925 (local address 127.12.177.190:33533)
0806 18:43:42.544789 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:42.544793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:42.546434 (+ 1641us) server_negotiation.cc:407] Connection header received
0806 18:43:42.548007 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:42.548011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:42.548074 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:42.548163 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:42.549489 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.550050 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.551387 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.551633 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.551764 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:42.553164 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:42.553168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:42.553170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:42.553186 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:42.553210 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:42.553218 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:42.553306 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:42.553547 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 18:43:42.553654 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 18:43:42.554987 9198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.545302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:33533 (local address 127.12.177.129:49925)
0806 18:43:42.546257 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:42.546307 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:42.547742 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:42.548525 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:42.548534 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:42.548637 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:42.549257 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.549274 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.550215 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.550219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:42.551210 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.551223 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.551847 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.551853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:42.552068 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:42.552817 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:42.552819 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:42.552872 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:42.552958 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:42.553310 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:42.553324 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:42.553333 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 18:43:42.553546 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 18:43:42.553899 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":198,"threads_started":1}
I20260806 18:43:42.556526 9194 heartbeater.cc:347] Connected to a master server at 127.12.177.190:33533
I20260806 18:43:42.556841 9194 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:42.557565 9194 heartbeater.cc:511] Master 127.12.177.190:33533 requested a full tablet report, sending...
I20260806 18:43:42.559332 8891 ts_manager.cc:194] Registered new tserver with Master: 16b9c18e7c6b40be87add00175e6e422 (127.12.177.129:35613)
I20260806 18:43:42.560586 8891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.129:49925
W20260806 18:43:42.681883 9200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:42.682240 9200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:42.682322 9200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:42.686825 9200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:42.686934 9200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:42.687036 9200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:42.692241 9200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:42.693670 9200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:42.695329 9200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:42.706786 9210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.706765 9206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.706745 9208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.707165 9200 server_base.cc:1034] running on GCE node
I20260806 18:43:42.707684 9200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:42.708468 9200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:42.709676 9200 hybrid_clock.cc:648] HybridClock initialized: now 1786041822709656 us; error 35 us; skew 500 ppm
I20260806 18:43:42.712086 9200 webserver.cc:460] Webserver started at http://127.12.177.130:46437/ using document root <none> and password file <none>
I20260806 18:43:42.712759 9200 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:42.712872 9200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:42.713137 9200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:42.715602 9200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "4619d1cd9027429f87a07fc71200f409"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "66f4bafaed9c948c26989603a7fe1324"
server_key_iv: "ba943ec05a67533c07a80e6efb332c92"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.716286 9200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "4619d1cd9027429f87a07fc71200f409"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "66f4bafaed9c948c26989603a7fe1324"
server_key_iv: "ba943ec05a67533c07a80e6efb332c92"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.721017 9200 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 18:43:42.724123 9222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.725755 9200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:42.725934 9200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "4619d1cd9027429f87a07fc71200f409"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "66f4bafaed9c948c26989603a7fe1324"
server_key_iv: "ba943ec05a67533c07a80e6efb332c92"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.726094 9200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:42.740851 9200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:42.741827 9200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:42.742079 9200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:42.742800 9200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:42.743930 9200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:42.744009 9200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.744088 9200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:42.744140 9200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.755215 9200 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:38571
I20260806 18:43:42.755313 9410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:38571 every 8 connection(s)
I20260806 18:43:42.756321 9200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:42.765862 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 9200
I20260806 18:43:42.765992 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:42.766351 12998 external_mini_cluster.cc:1428] Setting key 4cde90d0c7b6bea60cb2bc298dd4390e
I20260806 18:43:42.768086 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.758526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:51559 (local address 127.12.177.190:33533)
0806 18:43:42.758743 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:42.758749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:42.760050 (+ 1301us) server_negotiation.cc:407] Connection header received
0806 18:43:42.761748 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:42.761751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:42.761814 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:42.761901 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:42.763037 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.763593 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.765252 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.765773 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.765924 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:42.767364 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:42.767367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:42.767369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:42.767383 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:42.767405 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:42.767414 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:42.767486 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:42.767760 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 18:43:42.767913 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 18:43:42.768867 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--builtin_ntp_servers=127.12.177.148:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:42.769316 9417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.759039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:33533 (local address 127.12.177.130:51559)
0806 18:43:42.759849 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:42.759898 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:42.761480 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:42.762116 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:42.762125 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:42.762227 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:42.762836 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.762852 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.763768 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.763772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:42.765043 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.765058 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.765990 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.765994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:42.766223 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:42.767027 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:42.767029 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:42.767084 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:42.767172 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:42.767514 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:42.767525 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:42.767532 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:43:42.767687 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 18:43:42.768120 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":150,"threads_started":1}
I20260806 18:43:42.770915 9413 heartbeater.cc:347] Connected to a master server at 127.12.177.190:33533
I20260806 18:43:42.771251 9413 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:42.771970 9413 heartbeater.cc:511] Master 127.12.177.190:33533 requested a full tablet report, sending...
I20260806 18:43:42.773452 8891 ts_manager.cc:194] Registered new tserver with Master: 4619d1cd9027429f87a07fc71200f409 (127.12.177.130:38571)
I20260806 18:43:42.774112 8891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.130:51559
W20260806 18:43:42.911860 9418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:42.912264 9418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:42.912317 9418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:42.917420 9418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:42.917519 9418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:42.917584 9418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:42.923002 9418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:33533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:42.924360 9418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:42.926014 9418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:42.937685 9430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.937877 9425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:42.937685 9426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:42.938022 9418 server_base.cc:1034] running on GCE node
I20260806 18:43:42.938711 9418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:42.939541 9418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:42.940765 9418 hybrid_clock.cc:648] HybridClock initialized: now 1786041822940738 us; error 40 us; skew 500 ppm
I20260806 18:43:42.943617 9418 webserver.cc:460] Webserver started at http://127.12.177.131:37425/ using document root <none> and password file <none>
I20260806 18:43:42.944334 9418 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:42.944448 9418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:42.944718 9418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:42.947253 9418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "4300c96bfb9348b2a13cccd550ff41ce"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "f7dd3ad6d7b2ae6ba964562d94aff1c2"
server_key_iv: "624e24262020fc6cf8d458b5fc5a3f32"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.947964 9418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "4300c96bfb9348b2a13cccd550ff41ce"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "f7dd3ad6d7b2ae6ba964562d94aff1c2"
server_key_iv: "624e24262020fc6cf8d458b5fc5a3f32"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.952661 9418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:43:42.956092 9442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.957861 9418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:42.958068 9418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "4300c96bfb9348b2a13cccd550ff41ce"
format_stamp: "Formatted at 2026-08-06 18:43:42 on dist-test-slave-j2vl"
server_key: "f7dd3ad6d7b2ae6ba964562d94aff1c2"
server_key_iv: "624e24262020fc6cf8d458b5fc5a3f32"
server_key_version: "encryptionkey@0"
I20260806 18:43:42.958225 9418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:42.975111 9418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:42.975987 9418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:42.976224 9418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:42.976951 9418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:42.978420 9418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:42.978515 9418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.978600 9418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:42.978652 9418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:42.989617 9418 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:37083
I20260806 18:43:42.989645 9634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:37083 every 8 connection(s)
I20260806 18:43:42.990893 9418 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:43.000276 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 9418
I20260806 18:43:43.000463 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:43.000854 12998 external_mini_cluster.cc:1428] Setting key ddf710fcfd988441834e7c07be85dbe8
I20260806 18:43:43.003120 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.993383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:34133 (local address 127.12.177.190:33533)
0806 18:43:42.993538 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:42.993542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:42.994644 (+ 1102us) server_negotiation.cc:407] Connection header received
0806 18:43:42.996234 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:42.996237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:42.996304 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:42.996419 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:42.997897 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.998495 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.000254 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.000635 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.000742 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.002463 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:43.002470 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:43.002477 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:43.002495 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:43.002527 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:43.002540 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:43.002619 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.002892 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.002971 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 18:43:43.004354 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:42.993710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:33533 (local address 127.12.177.131:34133)
0806 18:43:42.994470 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:42.994516 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:42.995973 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:42.996642 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:42.996650 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:42.996752 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:42.997582 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.997605 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:42.998690 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:42.998693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:42.999935 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:42.999955 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.000850 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.000855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.001134 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.002019 (+ 885us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:43.002021 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:43.002107 (+ 86us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:43.002218 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:43.002679 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:43.002693 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:43.002701 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.002866 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.003232 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":153,"threads_started":1}
I20260806 18:43:43.005895 9635 heartbeater.cc:347] Connected to a master server at 127.12.177.190:33533
I20260806 18:43:43.006206 9635 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:43.006892 9635 heartbeater.cc:511] Master 127.12.177.190:33533 requested a full tablet report, sending...
I20260806 18:43:43.008271 8891 ts_manager.cc:194] Registered new tserver with Master: 4300c96bfb9348b2a13cccd550ff41ce (127.12.177.131:37083)
I20260806 18:43:43.008935 8891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.131:34133
I20260806 18:43:43.016299 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:43.023072 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.018651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.12.177.190:33533)
0806 18:43:43.018882 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.018887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.019039 (+ 152us) server_negotiation.cc:407] Connection header received
0806 18:43:43.019229 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.019233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.019286 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.019385 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:43.019705 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.020248 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.021169 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.021421 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.021541 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.022523 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:43.022526 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:43.022528 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:43.022542 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:43.022562 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:43.022571 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:43.022702 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.022879 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.022925 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 18:43:43.026543 8891 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:43.029889 8891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:43.046226 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.039790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:35613 (local address 127.0.0.1:57158)
0806 18:43:43.040651 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.040711 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:43.040860 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:43.041578 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:43.041587 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:43.041612 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:43.041772 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.041779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043307 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.043312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.044647 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.044658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.045621 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.045625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.045735 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.045773 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.045909 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.046038 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":34,"spinlock_wait_cycles":6400,"thread_start_us":138,"threads_started":1}
I20260806 18:43:43.046494 9655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.039600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:38571 (local address 127.0.0.1:48290)
0806 18:43:43.040649 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.040712 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:43.040860 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:43.041884 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:43.041888 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:43.041908 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:43.042015 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.042021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043618 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.043621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.044777 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.044786 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.046033 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.046035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.046151 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.046179 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.046252 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.046321 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":35,"spinlock_wait_cycles":3840,"thread_start_us":95,"threads_started":1}
I20260806 18:43:43.046262 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.040371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37083 (local address 127.0.0.1:34074)
0806 18:43:43.041315 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.041330 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:43.041502 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:43.042033 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:43.042036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:43.042056 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:43.042141 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.042147 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043141 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.043145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.044531 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.044541 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.045917 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.045920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.046001 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.046022 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.046096 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.046156 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":22,"thread_start_us":97,"threads_started":1}
I20260806 18:43:43.047034 9661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.040370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.12.177.130:38571)
0806 18:43:43.041131 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.041145 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.041175 (+ 30us) server_negotiation.cc:407] Connection header received
0806 18:43:43.041382 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.041389 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.041581 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.041724 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:43.042148 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043307 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.044886 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.045694 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.045809 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.045971 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.046732 (+ 761us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.046845 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":150,"threads_started":1}
I20260806 18:43:43.047047 9658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.040154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.12.177.129:35613)
0806 18:43:43.040624 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.040632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.041015 (+ 383us) server_negotiation.cc:407] Connection header received
0806 18:43:43.041110 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.041117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.041381 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.041538 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:43.041916 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043166 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.044797 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.045487 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.045622 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.045830 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.046359 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.046871 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":142,"threads_started":1}
I20260806 18:43:43.047124 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.040804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34074 (local address 127.12.177.131:37083)
0806 18:43:43.041287 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.041299 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.041477 (+ 178us) server_negotiation.cc:407] Connection header received
0806 18:43:43.041663 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.041668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.041868 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.042060 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:43.042244 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.043016 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.044664 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.045535 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.045672 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.045866 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.046161 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.046295 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":160,"threads_started":1}
I20260806 18:43:43.050128 9095 tablet_service.cc:1467] Processing CreateTablet for tablet 16d46755ed11420ea2431ba6941ba954 (DEFAULT_TABLE table=test-table [id=f161ac84e2aa4ec497b5554350f063c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:43.050199 9305 tablet_service.cc:1467] Processing CreateTablet for tablet 16d46755ed11420ea2431ba6941ba954 (DEFAULT_TABLE table=test-table [id=f161ac84e2aa4ec497b5554350f063c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:43.050599 9516 tablet_service.cc:1467] Processing CreateTablet for tablet 16d46755ed11420ea2431ba6941ba954 (DEFAULT_TABLE table=test-table [id=f161ac84e2aa4ec497b5554350f063c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:43.051412 9305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16d46755ed11420ea2431ba6941ba954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:43.051412 9095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16d46755ed11420ea2431ba6941ba954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:43.051573 9516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16d46755ed11420ea2431ba6941ba954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:43.059101 9663 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Bootstrap starting.
I20260806 18:43:43.060317 9667 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Bootstrap starting.
I20260806 18:43:43.060388 9669 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Bootstrap starting.
I20260806 18:43:43.061733 9663 tablet_bootstrap.cc:654] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:43.062707 9667 tablet_bootstrap.cc:654] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:43.062708 9669 tablet_bootstrap.cc:654] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:43.063364 9663 log.cc:824] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:43.063627 9667 log.cc:824] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:43.063627 9669 log.cc:824] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:43.066073 9663 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: No bootstrap required, opened a new log
I20260806 18:43:43.066339 9663 ts_tablet_manager.cc:1397] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:43:43.066488 9667 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: No bootstrap required, opened a new log
I20260806 18:43:43.066624 9669 tablet_bootstrap.cc:492] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: No bootstrap required, opened a new log
I20260806 18:43:43.066685 9667 ts_tablet_manager.cc:1397] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 18:43:43.066859 9669 ts_tablet_manager.cc:1397] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:43:43.070349 9669 raft_consensus.cc:348] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.070752 9669 raft_consensus.cc:374] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:43.070809 9669 raft_consensus.cc:729] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4619d1cd9027429f87a07fc71200f409, State: Initialized, Role: FOLLOWER
I20260806 18:43:43.071369 9669 consensus_queue.cc:260] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.071936 9667 raft_consensus.cc:348] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.071930 9663 raft_consensus.cc:348] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.072209 9667 raft_consensus.cc:374] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:43.072211 9663 raft_consensus.cc:374] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:43.072275 9667 raft_consensus.cc:729] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4300c96bfb9348b2a13cccd550ff41ce, State: Initialized, Role: FOLLOWER
I20260806 18:43:43.072274 9663 raft_consensus.cc:729] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b9c18e7c6b40be87add00175e6e422, State: Initialized, Role: FOLLOWER
I20260806 18:43:43.072563 9669 ts_tablet_manager.cc:1428] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 18:43:43.072806 9667 consensus_queue.cc:260] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.072978 9413 heartbeater.cc:503] Master 127.12.177.190:33533 was elected leader, sending a full tablet report...
I20260806 18:43:43.073621 9635 heartbeater.cc:503] Master 127.12.177.190:33533 was elected leader, sending a full tablet report...
I20260806 18:43:43.073961 9667 ts_tablet_manager.cc:1428] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 18:43:43.074542 9663 consensus_queue.cc:260] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.075361 9194 heartbeater.cc:503] Master 127.12.177.190:33533 was elected leader, sending a full tablet report...
I20260806 18:43:43.077939 9663 ts_tablet_manager.cc:1428] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
W20260806 18:43:43.242122 9637 tablet.cc:2369] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:43.257125 9675 raft_consensus.cc:482] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:43.257470 9675 raft_consensus.cc:504] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
W20260806 18:43:43.257822 9416 tablet.cc:2369] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:43.258847 9675 leader_election.cc:288] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16b9c18e7c6b40be87add00175e6e422 (127.12.177.129:35613), 4300c96bfb9348b2a13cccd550ff41ce (127.12.177.131:37083)
I20260806 18:43:43.264365 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.259645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37083 (local address 127.12.177.130:60235)
0806 18:43:43.260027 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.260043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:43.260135 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:43.260446 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:43.260448 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:43.260464 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:43.260590 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.260595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.261557 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.261561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.262631 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.262656 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.263674 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.263679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.263790 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.263824 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.263928 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.264057 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":39,"thread_start_us":159,"threads_started":1}
I20260806 18:43:43.264762 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.259900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:60235 (local address 127.12.177.131:37083)
0806 18:43:43.260089 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.260093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.260109 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:43:43.260260 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.260262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.260330 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.260414 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:43.260710 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.261438 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.262791 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.263494 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.263655 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.263721 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.264520 (+ 799us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.264632 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 18:43:43.265588 9658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.259399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:54143 (local address 127.12.177.129:35613)
0806 18:43:43.259559 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.259564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.259621 (+ 57us) server_negotiation.cc:407] Connection header received
0806 18:43:43.259895 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.259899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.259964 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.260066 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:43.260385 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.261173 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.262858 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.263595 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.263703 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.263774 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.265301 (+ 1527us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.265451 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 18:43:43.264322 9417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.259246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:35613 (local address 127.12.177.130:54143)
0806 18:43:43.259489 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.259552 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:43.259696 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:43.260082 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:43.260087 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:43.260109 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:43.260265 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.260272 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.261333 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.261336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.262734 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:43.262747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.263824 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.263827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:43.263957 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.263982 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 18:43:43.264064 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 18:43:43.264155 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":187}
I20260806 18:43:43.266631 9551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16d46755ed11420ea2431ba6941ba954" candidate_uuid: "4619d1cd9027429f87a07fc71200f409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4300c96bfb9348b2a13cccd550ff41ce" is_pre_election: true
I20260806 18:43:43.266631 9127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16d46755ed11420ea2431ba6941ba954" candidate_uuid: "4619d1cd9027429f87a07fc71200f409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b9c18e7c6b40be87add00175e6e422" is_pre_election: true
I20260806 18:43:43.267071 9127 raft_consensus.cc:2454] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4619d1cd9027429f87a07fc71200f409 in term 0.
I20260806 18:43:43.267073 9551 raft_consensus.cc:2454] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4619d1cd9027429f87a07fc71200f409 in term 0.
I20260806 18:43:43.267803 9229 leader_election.cc:302] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b9c18e7c6b40be87add00175e6e422, 4619d1cd9027429f87a07fc71200f409; no voters:
I20260806 18:43:43.268198 9675 raft_consensus.cc:2781] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:43.268293 9675 raft_consensus.cc:482] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:43.268326 9675 raft_consensus.cc:3037] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:43.269601 9675 raft_consensus.cc:504] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.270048 9675 leader_election.cc:288] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [CANDIDATE]: Term 1 election: Requested vote from peers 16b9c18e7c6b40be87add00175e6e422 (127.12.177.129:35613), 4300c96bfb9348b2a13cccd550ff41ce (127.12.177.131:37083)
I20260806 18:43:43.270555 9127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16d46755ed11420ea2431ba6941ba954" candidate_uuid: "4619d1cd9027429f87a07fc71200f409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b9c18e7c6b40be87add00175e6e422"
I20260806 18:43:43.270678 9551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16d46755ed11420ea2431ba6941ba954" candidate_uuid: "4619d1cd9027429f87a07fc71200f409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4300c96bfb9348b2a13cccd550ff41ce"
I20260806 18:43:43.270715 9127 raft_consensus.cc:3037] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:43.270853 9551 raft_consensus.cc:3037] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:43.272013 9127 raft_consensus.cc:2454] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4619d1cd9027429f87a07fc71200f409 in term 1.
I20260806 18:43:43.272024 9551 raft_consensus.cc:2454] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4619d1cd9027429f87a07fc71200f409 in term 1.
I20260806 18:43:43.272408 9229 leader_election.cc:302] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b9c18e7c6b40be87add00175e6e422, 4619d1cd9027429f87a07fc71200f409; no voters:
I20260806 18:43:43.272699 9675 raft_consensus.cc:2781] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:43.272984 9675 raft_consensus.cc:686] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 1 LEADER]: Becoming Leader. State: Replica: 4619d1cd9027429f87a07fc71200f409, State: Running, Role: LEADER
I20260806 18:43:43.273461 9675 consensus_queue.cc:237] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } }
I20260806 18:43:43.277398 8887 catalog_manager.cc:5495] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4619d1cd9027429f87a07fc71200f409 (127.12.177.130). New cstate: current_term: 1 leader_uuid: "4619d1cd9027429f87a07fc71200f409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4619d1cd9027429f87a07fc71200f409" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 38571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 } health_report { overall_health: UNKNOWN } } }
I20260806 18:43:43.290575 9661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.286626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48300 (local address 127.12.177.130:38571)
0806 18:43:43.286771 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:43.286775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:43.286809 (+ 34us) server_negotiation.cc:407] Connection header received
0806 18:43:43.286887 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:43.286889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:43.286959 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:43.287049 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:43.287322 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.287857 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.288866 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:43.289103 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:43.289204 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:43.289604 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:43.290098 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:43.290222 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:43.290399 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 18:43:43.290442 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 18:43:43.295101 9196 tablet.cc:2369] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:43.298202 9551 raft_consensus.cc:1261] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 1 FOLLOWER]: Refusing update from remote peer 4619d1cd9027429f87a07fc71200f409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:43.298192 9127 raft_consensus.cc:1261] T 16d46755ed11420ea2431ba6941ba954 P 16b9c18e7c6b40be87add00175e6e422 [term 1 FOLLOWER]: Refusing update from remote peer 4619d1cd9027429f87a07fc71200f409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:43.299158 9680 consensus_queue.cc:1035] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b9c18e7c6b40be87add00175e6e422" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:43.299515 9675 consensus_queue.cc:1035] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4300c96bfb9348b2a13cccd550ff41ce" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:43.309715 9688 mvcc.cc:205] Tried to move back new op lower bound from 7315627308219764736 to 7315627308131483648. Current Snapshot: MvccSnapshot[applied={T|T < 7315627308219764736}]
I20260806 18:43:43.321074 8887 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:43.321260 8887 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:43.324025 8887 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e746db2c6a1840719c6382f4f571c7b4: Sending DeleteTablet for 3 replicas of tablet 16d46755ed11420ea2431ba6941ba954
I20260806 18:43:43.325078 9305 tablet_service.cc:1514] Processing DeleteTablet for tablet 16d46755ed11420ea2431ba6941ba954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:43 UTC) from {username='slave'} at 127.0.0.1:48290
I20260806 18:43:43.325055 9095 tablet_service.cc:1514] Processing DeleteTablet for tablet 16d46755ed11420ea2431ba6941ba954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:43 UTC) from {username='slave'} at 127.0.0.1:57158
I20260806 18:43:43.325130 9516 tablet_service.cc:1514] Processing DeleteTablet for tablet 16d46755ed11420ea2431ba6941ba954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:43 UTC) from {username='slave'} at 127.0.0.1:34074
I20260806 18:43:43.325878 9703 tablet_replica.cc:330] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: stopping tablet replica
I20260806 18:43:43.326045 9699 tablet_replica.cc:330] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: stopping tablet replica
I20260806 18:43:43.326363 9703 raft_consensus.cc:2229] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:43.326514 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8994
I20260806 18:43:43.326774 9703 raft_consensus.cc:2258] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:43.337265 9699 raft_consensus.cc:2229] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:43:43.338238 9699 raft_consensus.cc:2258] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:43.338442 9703 ts_tablet_manager.cc:1905] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:43.342584 9703 ts_tablet_manager.cc:1918] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:43.342767 9703 log.cc:1196] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/16d46755ed11420ea2431ba6941ba954
I20260806 18:43:43.343044 9699 ts_tablet_manager.cc:1905] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:43.343165 9703 ts_tablet_manager.cc:1939] T 16d46755ed11420ea2431ba6941ba954 P 4300c96bfb9348b2a13cccd550ff41ce: Deleting consensus metadata
I20260806 18:43:43.344949 8866 catalog_manager.cc:4841] TS 4300c96bfb9348b2a13cccd550ff41ce (127.12.177.131:37083): tablet 16d46755ed11420ea2431ba6941ba954 (table test-table [id=f161ac84e2aa4ec497b5554350f063c2]) successfully deleted
I20260806 18:43:43.347360 9699 ts_tablet_manager.cc:1918] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:43.347518 9699 log.cc:1196] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/16d46755ed11420ea2431ba6941ba954
I20260806 18:43:43.347958 9699 ts_tablet_manager.cc:1939] T 16d46755ed11420ea2431ba6941ba954 P 4619d1cd9027429f87a07fc71200f409: Deleting consensus metadata
I20260806 18:43:43.349691 8871 catalog_manager.cc:4841] TS 4619d1cd9027429f87a07fc71200f409 (127.12.177.130:38571): tablet 16d46755ed11420ea2431ba6941ba954 (table test-table [id=f161ac84e2aa4ec497b5554350f063c2]) successfully deleted
W20260806 18:43:43.349776 8866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:35613 (error 108)
I20260806 18:43:43.350942 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 9200
I20260806 18:43:43.351092 9655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:43.350702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:35613 (local address 127.0.0.1:57172)
0806 18:43:43.350889 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:43.350978 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:35613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 18:43:43.351315 8866 catalog_manager.cc:4584] TS 16b9c18e7c6b40be87add00175e6e422 (127.12.177.129:35613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 16d46755ed11420ea2431ba6941ba954: Network error: Client connection negotiation failed: client connection to 127.12.177.129:35613: connect: Connection refused (error 111)
I20260806 18:43:43.365257 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 9418
I20260806 18:43:43.382848 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 8841
2026-08-06T18:43:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1401 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:43 dist-test-slave-j2vl krb5kdc[9707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:43 dist-test-slave-j2vl krb5kdc[9707](info): set up 2 sockets
Aug 06 18:43:43 dist-test-slave-j2vl krb5kdc[9707](info): commencing operation
krb5kdc: starting...
W20260806 18:43:44.659683 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:44 dist-test-slave-j2vl krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:43:44.810398 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45233
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:45233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:44.937515 9724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:44.937896 9724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:44.937983 9724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:44.942412 9724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:44.942531 9724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:44.942569 9724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:44.942610 9724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:44.942647 9724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:44.948524 9724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:45233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:45233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:44.950805 9724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:44.952179 9724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:44.961894 9736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:44.961905 9741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:44.961932 9724 server_base.cc:1034] running on GCE node
W20260806 18:43:44.962034 9735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:44.962946 9724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:44.964672 9724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:44.965905 9724 hybrid_clock.cc:648] HybridClock initialized: now 1786041824965893 us; error 49 us; skew 500 ppm
Aug 06 18:43:44 dist-test-slave-j2vl krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041824, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:44.973927 9724 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:43:44.975198 9724 webserver.cc:460] Webserver started at http://127.12.177.190:43077/ using document root <none> and password file <none>
I20260806 18:43:44.975879 9724 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:44.975956 9724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:44.976222 9724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:44.979024 9724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "97fc8ab4df65430e9e1f8dd7441b855e"
format_stamp: "Formatted at 2026-08-06 18:43:44 on dist-test-slave-j2vl"
server_key: "ae20d93978cf23278b1a241fda6024cd"
server_key_iv: "f39cbe03d46f25c596aec75e829e593b"
server_key_version: "encryptionkey@0"
I20260806 18:43:44.979964 9724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "97fc8ab4df65430e9e1f8dd7441b855e"
format_stamp: "Formatted at 2026-08-06 18:43:44 on dist-test-slave-j2vl"
server_key: "ae20d93978cf23278b1a241fda6024cd"
server_key_iv: "f39cbe03d46f25c596aec75e829e593b"
server_key_version: "encryptionkey@0"
I20260806 18:43:44.984628 9724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 18:43:44.987675 9749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:44.989046 9724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:43:44.989205 9724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "97fc8ab4df65430e9e1f8dd7441b855e"
format_stamp: "Formatted at 2026-08-06 18:43:44 on dist-test-slave-j2vl"
server_key: "ae20d93978cf23278b1a241fda6024cd"
server_key_iv: "f39cbe03d46f25c596aec75e829e593b"
server_key_version: "encryptionkey@0"
I20260806 18:43:44.989346 9724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:45.009996 9724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:45.013465 9724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:45.013707 9724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:45.021886 9724 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:45233
I20260806 18:43:45.021906 9823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:45233 every 8 connection(s)
I20260806 18:43:45.022977 9724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:45.026094 9827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:45.030423 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 9724
I20260806 18:43:45.030588 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:45.030901 12998 external_mini_cluster.cc:1428] Setting key 840af31352e5090da1300e35f04a0ee7
I20260806 18:43:45.033589 9827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: Bootstrap starting.
I20260806 18:43:45.036084 9827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:45.036938 9827 log.cc:824] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:45.039608 9827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: No bootstrap required, opened a new log
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:45.043587 9827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } }
I20260806 18:43:45.043893 9827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:45.043968 9827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97fc8ab4df65430e9e1f8dd7441b855e, State: Initialized, Role: FOLLOWER
I20260806 18:43:45.044454 9827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } }
I20260806 18:43:45.044595 9827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:45.044690 9827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:45.044795 9827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:45.045966 9827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } }
I20260806 18:43:45.046368 9827 leader_election.cc:302] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97fc8ab4df65430e9e1f8dd7441b855e; no voters:
I20260806 18:43:45.046808 9827 leader_election.cc:288] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:45.047220 9832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:45.047458 9832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [term 1 LEADER]: Becoming Leader. State: Replica: 97fc8ab4df65430e9e1f8dd7441b855e, State: Running, Role: LEADER
I20260806 18:43:45.047802 9832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } }
I20260806 18:43:45.048419 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.032743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.12.177.190:45233)
0806 18:43:45.033447 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.033470 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.033511 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:43:45.034296 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.034316 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.034682 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.035077 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:45.035954 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.037147 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.038325 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.038845 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.039035 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.042062 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:45.042068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:45.042086 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:45.042121 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:45.044700 (+ 2579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.045260 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.045267 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.045274 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.045484 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.045787 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.045791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.045793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.046352 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:45.046582 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.046875 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.047297 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":154,"threads_started":1}
I20260806 18:43:45.048620 9827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:45.049804 9834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97fc8ab4df65430e9e1f8dd7441b855e. Latest consensus state: current_term: 1 leader_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } } }
I20260806 18:43:45.049958 9834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:45.050276 9833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97fc8ab4df65430e9e1f8dd7441b855e" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 45233 } } }
I20260806 18:43:45.050395 9833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:45.050751 9842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:45.054355 9842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:45.061093 9842 catalog_manager.cc:1347] Generated new cluster ID: 27b86c8c320e4151bca742614ebc90c0
I20260806 18:43:45.061201 9842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:45.085045 9842 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:45.086223 9842 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:45.095518 9842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: Generated new TSK 0
I20260806 18:43:45.096432 9842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.177.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
Entry for principal kudu/127.12.177.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab.
I20260806 18:43:45.146770 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:45.283856 9866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:45.284188 9866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:45.284235 9866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:45.288859 9866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:45.288962 9866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:45.289057 9866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:45.295404 9866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.129.keytab
--principal=kudu/127.12.177.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:45.296701 9866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:45.297938 9866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:45.310156 9877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:45.310163 9875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:45.310163 9881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:45.310213 9866 server_base.cc:1034] running on GCE node
I20260806 18:43:45.311184 9866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:45.311962 9866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:45.313174 9866 hybrid_clock.cc:648] HybridClock initialized: now 1786041825313133 us; error 65 us; skew 500 ppm
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:45.316684 9866 init.cc:377] Logged in from keytab as kudu/127.12.177.129@KRBTEST.COM (short username kudu)
I20260806 18:43:45.317866 9866 webserver.cc:460] Webserver started at http://127.12.177.129:35457/ using document root <none> and password file <none>
I20260806 18:43:45.318470 9866 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:45.318535 9866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:45.318784 9866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:45.321575 9866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "d04517afbb4348e4b6c5809f72306bdb"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "f1e1e03543a425592ea7eb44365bf995"
server_key_iv: "242d241ddf7f079017752c58e4f1413f"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.322464 9866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "d04517afbb4348e4b6c5809f72306bdb"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "f1e1e03543a425592ea7eb44365bf995"
server_key_iv: "242d241ddf7f079017752c58e4f1413f"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.326946 9866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:43:45.330289 9890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.332269 9866 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:43:45.332418 9866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "d04517afbb4348e4b6c5809f72306bdb"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "f1e1e03543a425592ea7eb44365bf995"
server_key_iv: "242d241ddf7f079017752c58e4f1413f"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.332553 9866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:45.349256 9866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:45.353238 9866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:45.353579 9866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:45.354281 9866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:45.355268 9866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:45.355345 9866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.355420 9866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:45.355471 9866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.366645 9866 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:35595
I20260806 18:43:45.366665 10069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:35595 every 8 connection(s)
I20260806 18:43:45.367723 9866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:45.376667 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 9866
I20260806 18:43:45.376868 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:45.377188 12998 external_mini_cluster.cc:1428] Setting key dbcbca1f698e0f73048dc16e1c71d3bf
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.129@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:45.387209 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.370047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:42887 (local address 127.12.177.190:45233)
0806 18:43:45.370232 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.370237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.371417 (+ 1180us) server_negotiation.cc:407] Connection header received
0806 18:43:45.373231 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.373235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.373302 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.373517 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:45.375544 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.376296 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.378097 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.378569 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.378705 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.382181 (+ 3476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:45.382185 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:45.382188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:45.382221 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:45.384002 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.384905 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.384909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.384910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.385015 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.385638 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.385641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.385642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.385876 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:45.386079 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.386904 (+ 825us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.387066 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:43:45.388913 10074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.370531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45233 (local address 127.12.177.129:42887)
0806 18:43:45.371186 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.371243 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.372731 (+ 1488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.373744 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.373753 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.374236 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:45.375232 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.375253 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.376515 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.376525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.377829 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.377843 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.378797 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.378800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.379154 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.379925 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:45.379946 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:45.381888 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:45.384187 (+ 2299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.384199 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.384225 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.384717 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.385146 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.385152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.385157 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.385486 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.386025 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:45.386038 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:45.386521 (+ 483us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.386818 (+ 297us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.387484 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":160,"threads_started":1}
WARNING: no policy specified for kudu/127.12.177.130@KRBTEST.COM; defaulting to no policy
I20260806 18:43:45.390791 10070 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45233
I20260806 18:43:45.391109 10070 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:45.391733 10070 heartbeater.cc:511] Master 127.12.177.190:45233 requested a full tablet report, sending...
I20260806 18:43:45.394193 9774 ts_manager.cc:194] Registered new tserver with Master: d04517afbb4348e4b6c5809f72306bdb (127.12.177.129:35595)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.130@KRBTEST.COM" created.
I20260806 18:43:45.395552 9774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.129@KRBTEST.COM'} at 127.12.177.129:42887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
Entry for principal kudu/127.12.177.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab.
I20260806 18:43:45.417770 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:45.548566 10078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:45.548923 10078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:45.548977 10078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:45.553649 10078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:45.553740 10078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:45.553812 10078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:45.559993 10078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.130.keytab
--principal=kudu/127.12.177.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:45.561228 10078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:45.562433 10078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:45.573910 10085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:45.573963 10088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:45.573922 10086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:45.574146 10078 server_base.cc:1034] running on GCE node
I20260806 18:43:45.574808 10078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:45.575574 10078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:45.576891 10078 hybrid_clock.cc:648] HybridClock initialized: now 1786041825576870 us; error 65 us; skew 500 ppm
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:45.580500 10078 init.cc:377] Logged in from keytab as kudu/127.12.177.130@KRBTEST.COM (short username kudu)
I20260806 18:43:45.581823 10078 webserver.cc:460] Webserver started at http://127.12.177.130:44433/ using document root <none> and password file <none>
I20260806 18:43:45.582520 10078 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:45.582634 10078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:45.582914 10078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:45.585289 10078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "395cd4132faa4420abff19fa03af446d"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "bb97c4157d855c4ad80f457445d5ffca"
server_key_iv: "bab4a64bbb799b9f1d3b86d2a26c95a1"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.586058 10078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "395cd4132faa4420abff19fa03af446d"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "bb97c4157d855c4ad80f457445d5ffca"
server_key_iv: "bab4a64bbb799b9f1d3b86d2a26c95a1"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.590847 10078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 18:43:45.594004 10100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.595692 10078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:43:45.595875 10078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "395cd4132faa4420abff19fa03af446d"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "bb97c4157d855c4ad80f457445d5ffca"
server_key_iv: "bab4a64bbb799b9f1d3b86d2a26c95a1"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.596135 10078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:45.617568 10078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:45.621667 10078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:45.621922 10078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:45.622646 10078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:45.623809 10078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:45.623962 10078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.624145 10078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:45.624220 10078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.635221 10078 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:45135
I20260806 18:43:45.635272 10269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:45135 every 8 connection(s)
I20260806 18:43:45.636350 10078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:45.637593 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 10078
I20260806 18:43:45.637723 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:45.638032 12998 external_mini_cluster.cc:1428] Setting key 91bdee3f57af7660f2256f5e6fffd5e0
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.130@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.131@KRBTEST.COM" created.
I20260806 18:43:45.655619 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.638847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:48145 (local address 127.12.177.190:45233)
0806 18:43:45.638998 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.639002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.640123 (+ 1121us) server_negotiation.cc:407] Connection header received
0806 18:43:45.641795 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.641799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.641864 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.641961 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:45.643902 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.644592 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.647021 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.647298 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.647404 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.651055 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:45.651059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:45.651061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:45.651091 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:45.652757 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.653483 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.653486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.653488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.653580 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.654132 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.654135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.654137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.654424 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:45.654547 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.655274 (+ 727us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.655434 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:43:45.656543 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.639157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45233 (local address 127.12.177.130:48145)
0806 18:43:45.639946 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.639998 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.641536 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.642163 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.642171 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.642707 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:45.643572 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.643598 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.644849 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.644857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.646735 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.646755 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.647538 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.647544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.647844 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.648684 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:45.648705 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:45.650819 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:45.652912 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.652920 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.652980 (+ 60us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.653307 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.653684 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.653687 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.653689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.654008 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.654548 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:45.654557 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:45.654964 (+ 407us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.655183 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.655589 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":203,"threads_started":1}
I20260806 18:43:45.658120 10270 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45233
I20260806 18:43:45.658447 10270 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:45.659171 10270 heartbeater.cc:511] Master 127.12.177.190:45233 requested a full tablet report, sending...
I20260806 18:43:45.660566 9774 ts_manager.cc:194] Registered new tserver with Master: 395cd4132faa4420abff19fa03af446d (127.12.177.130:45135)
I20260806 18:43:45.661219 9774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.130@KRBTEST.COM'} at 127.12.177.130:48145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
Entry for principal kudu/127.12.177.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab.
I20260806 18:43:45.678063 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:45.813131 10277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:45.813598 10277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:45.813660 10277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:45.818145 10277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:45.818235 10277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:45.818482 10277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:45.824950 10277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.131.keytab
--principal=kudu/127.12.177.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:45233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:45.826321 10277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:45.827418 10277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:45.841048 10288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:45.841022 10284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:45.841421 10277 server_base.cc:1034] running on GCE node
W20260806 18:43:45.841022 10285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:45.842180 10277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:45.842996 10277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:45.844238 10277 hybrid_clock.cc:648] HybridClock initialized: now 1786041825844171 us; error 82 us; skew 500 ppm
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:45.848724 10277 init.cc:377] Logged in from keytab as kudu/127.12.177.131@KRBTEST.COM (short username kudu)
I20260806 18:43:45.850092 10277 webserver.cc:460] Webserver started at http://127.12.177.131:44729/ using document root <none> and password file <none>
I20260806 18:43:45.850819 10277 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:45.850930 10277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:45.851223 10277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:45.853827 10277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "7a3eb9d04c5947788cfacfda47ab23ea"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "be8d9848b8c60131de01ca347f81bd2a"
server_key_iv: "eecf5902ecbc3cd804282e9f8f473799"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.854596 10277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "7a3eb9d04c5947788cfacfda47ab23ea"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "be8d9848b8c60131de01ca347f81bd2a"
server_key_iv: "eecf5902ecbc3cd804282e9f8f473799"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.859463 10277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:45.862834 10297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.864912 10277 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:43:45.865273 10277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "7a3eb9d04c5947788cfacfda47ab23ea"
format_stamp: "Formatted at 2026-08-06 18:43:45 on dist-test-slave-j2vl"
server_key: "be8d9848b8c60131de01ca347f81bd2a"
server_key_iv: "eecf5902ecbc3cd804282e9f8f473799"
server_key_version: "encryptionkey@0"
I20260806 18:43:45.865650 10277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:45.891620 10277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:45.895375 10277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:45.895610 10277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:45.896281 10277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:45.897230 10277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:45.897305 10277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.897449 10277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:45.897485 10277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:45.908648 10277 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:37697
I20260806 18:43:45.908743 10498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:37697 every 8 connection(s)
I20260806 18:43:45.909842 10277 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:45.918067 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 10277
I20260806 18:43:45.918249 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:45.918648 12998 external_mini_cluster.cc:1428] Setting key 94a7b26292ec2b1bf42be01e55ab9700
Aug 06 18:43:45 dist-test-slave-j2vl krb5kdc[9707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041825, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.131@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:43:45.926983 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.912116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:59825 (local address 127.12.177.190:45233)
0806 18:43:45.912285 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.912312 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.913402 (+ 1090us) server_negotiation.cc:407] Connection header received
0806 18:43:45.914937 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.914941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.915013 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.915123 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:45.916587 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.917156 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.918681 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.918969 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.919082 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.922529 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:45.922533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:45.922535 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:45.922566 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:45.924143 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.924800 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.924804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.924805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.924894 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.925623 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.925626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.925633 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.925854 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:45.926006 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.926624 (+ 618us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.926783 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:43:45.927917 10501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.912524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:45233 (local address 127.12.177.131:59825)
0806 18:43:45.913066 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.913117 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.914655 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.915350 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.915358 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.915789 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:45.916399 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.916416 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.917325 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.917328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.918510 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.918521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.919168 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.919173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.919377 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.920317 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:43:45.920342 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:45.922300 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:45.924301 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.924310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.924334 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.924666 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.925142 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:43:45.925146 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:43:45.925148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:43:45.925502 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:43:45.926006 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:45.926016 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:45.926344 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.926564 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.926972 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":153,"threads_started":1}
I20260806 18:43:45.929225 10499 heartbeater.cc:347] Connected to a master server at 127.12.177.190:45233
I20260806 18:43:45.929565 10499 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:45.930138 10499 heartbeater.cc:511] Master 127.12.177.190:45233 requested a full tablet report, sending...
I20260806 18:43:45.931420 9774 ts_manager.cc:194] Registered new tserver with Master: 7a3eb9d04c5947788cfacfda47ab23ea (127.12.177.131:37697)
I20260806 18:43:45.932085 9774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.177.131@KRBTEST.COM'} at 127.12.177.131:59825
I20260806 18:43:45.933230 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:45.945088 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.935907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37510 (local address 127.12.177.190:45233)
0806 18:43:45.936070 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.936076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.936323 (+ 247us) server_negotiation.cc:407] Connection header received
0806 18:43:45.936484 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.936487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.936541 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.936628 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:45.937828 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.938409 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.939340 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.939589 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.939709 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.941315 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:45.941319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:45.941321 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:45.941425 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:45.943037 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.943538 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.943542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.943544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.943640 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:45.943955 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:45.943959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:45.943961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:45.944236 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:45.944391 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.944655 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.944793 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 18:43:45.949568 9774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:45.953315 9774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:45.972148 10515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.964611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:45135 (local address 127.0.0.1:34090)
0806 18:43:45.965971 (+ 1360us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.965988 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.966164 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.967150 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.967155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.967179 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:45.967291 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.967299 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968887 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.968890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.970228 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.970241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.971658 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.971662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.971764 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.971794 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.971864 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.971948 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1289,"mutex_wait_us":7,"thread_start_us":102,"threads_started":1}
I20260806 18:43:45.972363 10519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.964406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37697 (local address 127.0.0.1:55150)
0806 18:43:45.965115 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.965177 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.965364 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.966733 (+ 1369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.966741 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.966773 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:45.966935 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.966943 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968780 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.968787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.970047 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.970062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.971355 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.971358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.971489 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.971538 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.971658 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.972193 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":51,"thread_start_us":110,"threads_started":1}
I20260806 18:43:45.973156 10522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.965427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.12.177.131:37697)
0806 18:43:45.966221 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.966237 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.966264 (+ 27us) server_negotiation.cc:407] Connection header received
0806 18:43:45.966357 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.966367 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.966544 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.966731 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:45.967100 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968564 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.970228 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.971193 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.971355 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.971536 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.972826 (+ 1290us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.972988 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":181,"threads_started":1}
I20260806 18:43:45.973392 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.964415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:35595 (local address 127.0.0.1:39206)
0806 18:43:45.965892 (+ 1477us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:45.965908 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:45.966088 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:45.966921 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:45.966923 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:45.966940 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:45.967051 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.967059 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968513 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.968520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.971063 (+ 2543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:45.971074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.972911 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.972915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:45.973006 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.973028 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 18:43:45.973102 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 18:43:45.973181 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1396,"mutex_wait_us":1296,"thread_start_us":167,"threads_started":1}
I20260806 18:43:45.973403 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.964573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39206 (local address 127.12.177.129:35595)
0806 18:43:45.965716 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.965725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.966006 (+ 281us) server_negotiation.cc:407] Connection header received
0806 18:43:45.966300 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.966310 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.966559 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.966726 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:45.967180 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968075 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.971243 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.972717 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.972917 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.973076 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.973134 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.973236 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1001,"thread_start_us":70,"threads_started":1}
I20260806 18:43:45.974255 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:45.965427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.12.177.130:45135)
0806 18:43:45.965958 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:45.965971 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:45.966079 (+ 108us) server_negotiation.cc:407] Connection header received
0806 18:43:45.966378 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:45.966384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:45.966558 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:45.966726 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:45.967483 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.968715 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.970481 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:45.971520 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:45.971671 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:45.973840 (+ 2169us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:45.973926 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 18:43:45.974059 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":185,"threads_started":1}
I20260806 18:43:45.976887 10371 tablet_service.cc:1467] Processing CreateTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b (DEFAULT_TABLE table=test-table [id=efbb9150d00045988cce3641a21d5b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:45.976805 9974 tablet_service.cc:1467] Processing CreateTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b (DEFAULT_TABLE table=test-table [id=efbb9150d00045988cce3641a21d5b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:45.977046 10174 tablet_service.cc:1467] Processing CreateTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b (DEFAULT_TABLE table=test-table [id=efbb9150d00045988cce3641a21d5b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:45.978240 10174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d2c76ab46048e8b1ba3980c63ba54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:45.978240 9974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d2c76ab46048e8b1ba3980c63ba54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:45.978240 10371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d2c76ab46048e8b1ba3980c63ba54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:45.987509 10523 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Bootstrap starting.
I20260806 18:43:45.987632 10525 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Bootstrap starting.
I20260806 18:43:45.988816 10526 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Bootstrap starting.
I20260806 18:43:45.990793 10525 tablet_bootstrap.cc:654] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:45.990793 10523 tablet_bootstrap.cc:654] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:45.991253 10526 tablet_bootstrap.cc:654] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:45.992174 10525 log.cc:824] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:45.992486 10526 log.cc:824] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:45.992563 10523 log.cc:824] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:45.995075 10523 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: No bootstrap required, opened a new log
I20260806 18:43:45.995065 10525 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: No bootstrap required, opened a new log
I20260806 18:43:45.995128 10526 tablet_bootstrap.cc:492] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: No bootstrap required, opened a new log
I20260806 18:43:45.995343 10523 ts_tablet_manager.cc:1397] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 18:43:45.995343 10526 ts_tablet_manager.cc:1397] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 18:43:45.995344 10525 ts_tablet_manager.cc:1397] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 18:43:45.999126 10523 raft_consensus.cc:348] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:45.999475 10523 raft_consensus.cc:374] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:45.999537 10523 raft_consensus.cc:729] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3eb9d04c5947788cfacfda47ab23ea, State: Initialized, Role: FOLLOWER
I20260806 18:43:45.999740 10526 raft_consensus.cc:348] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.000037 10526 raft_consensus.cc:374] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:46.000097 10526 raft_consensus.cc:729] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395cd4132faa4420abff19fa03af446d, State: Initialized, Role: FOLLOWER
I20260806 18:43:46.000123 10523 consensus_queue.cc:260] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.000164 10525 raft_consensus.cc:348] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.000458 10525 raft_consensus.cc:374] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:46.000522 10525 raft_consensus.cc:729] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04517afbb4348e4b6c5809f72306bdb, State: Initialized, Role: FOLLOWER
I20260806 18:43:46.000589 10526 consensus_queue.cc:260] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.000993 10525 consensus_queue.cc:260] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.001523 10270 heartbeater.cc:503] Master 127.12.177.190:45233 was elected leader, sending a full tablet report...
I20260806 18:43:46.001633 10523 ts_tablet_manager.cc:1428] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260806 18:43:46.002005 10525 ts_tablet_manager.cc:1428] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Time spent starting tablet: real 0.007s user 0.001s sys 0.007s
I20260806 18:43:46.002022 10499 heartbeater.cc:503] Master 127.12.177.190:45233 was elected leader, sending a full tablet report...
I20260806 18:43:46.002365 10070 heartbeater.cc:503] Master 127.12.177.190:45233 was elected leader, sending a full tablet report...
I20260806 18:43:46.002945 10526 ts_tablet_manager.cc:1428] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 18:43:46.042652 10538 raft_consensus.cc:482] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:46.042892 10538 raft_consensus.cc:504] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.044107 10538 leader_election.cc:288] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3eb9d04c5947788cfacfda47ab23ea (127.12.177.131:37697), 395cd4132faa4420abff19fa03af446d (127.12.177.130:45135)
I20260806 18:43:46.049873 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.044747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:54253 (local address 127.12.177.130:45135)
0806 18:43:46.044924 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:46.044929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:46.045178 (+ 249us) server_negotiation.cc:407] Connection header received
0806 18:43:46.045454 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:46.045460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:46.045525 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:46.045618 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:46.045981 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.046840 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.048341 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.048994 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.049107 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.049162 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:46.049618 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 18:43:46.049715 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 18:43:46.049873 10522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.044745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:56987 (local address 127.12.177.131:37697)
0806 18:43:46.045045 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:46.045051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:46.045164 (+ 113us) server_negotiation.cc:407] Connection header received
0806 18:43:46.045504 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:46.045507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:46.045568 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:46.045622 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:46.046120 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.046861 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.048262 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.048945 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.049099 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.049162 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:46.049618 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 18:43:46.049715 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260806 18:43:46.050043 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.044536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:45135 (local address 127.12.177.129:54253)
0806 18:43:46.045044 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:46.045062 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:46.045286 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:46.045646 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:46.045649 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:46.045670 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:46.045839 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.045847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.047004 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.047007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.048104 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.048115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.049161 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.049166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.049436 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.049491 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 18:43:46.049581 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 18:43:46.049716 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":193,"spinlock_wait_cycles":34432,"thread_start_us":122,"threads_started":1}
I20260806 18:43:46.050041 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.044535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:37697 (local address 127.12.177.129:56987)
0806 18:43:46.045048 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:46.045066 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:46.045286 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:46.045813 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:46.045815 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:46.045831 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:46.045981 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.045988 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.047009 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.047013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.048102 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.048114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.049161 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.049166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.049422 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.049493 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 18:43:46.049581 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 18:43:46.049717 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":207,"spinlock_wait_cycles":6272,"thread_start_us":190,"threads_started":1}
I20260806 18:43:46.051002 10406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d2c76ab46048e8b1ba3980c63ba54b" candidate_uuid: "d04517afbb4348e4b6c5809f72306bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" is_pre_election: true
I20260806 18:43:46.051002 10204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d2c76ab46048e8b1ba3980c63ba54b" candidate_uuid: "d04517afbb4348e4b6c5809f72306bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395cd4132faa4420abff19fa03af446d" is_pre_election: true
I20260806 18:43:46.051421 10204 raft_consensus.cc:2454] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04517afbb4348e4b6c5809f72306bdb in term 0.
I20260806 18:43:46.051422 10406 raft_consensus.cc:2454] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04517afbb4348e4b6c5809f72306bdb in term 0.
I20260806 18:43:46.052047 9892 leader_election.cc:302] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 395cd4132faa4420abff19fa03af446d, 7a3eb9d04c5947788cfacfda47ab23ea, d04517afbb4348e4b6c5809f72306bdb; no voters:
I20260806 18:43:46.052428 10538 raft_consensus.cc:2781] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:46.052548 10538 raft_consensus.cc:482] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:46.052608 10538 raft_consensus.cc:3037] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:46.053905 10538 raft_consensus.cc:504] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.054345 10538 leader_election.cc:288] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [CANDIDATE]: Term 1 election: Requested vote from peers 7a3eb9d04c5947788cfacfda47ab23ea (127.12.177.131:37697), 395cd4132faa4420abff19fa03af446d (127.12.177.130:45135)
I20260806 18:43:46.055290 10406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d2c76ab46048e8b1ba3980c63ba54b" candidate_uuid: "d04517afbb4348e4b6c5809f72306bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3eb9d04c5947788cfacfda47ab23ea"
I20260806 18:43:46.055290 10204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d2c76ab46048e8b1ba3980c63ba54b" candidate_uuid: "d04517afbb4348e4b6c5809f72306bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395cd4132faa4420abff19fa03af446d"
I20260806 18:43:46.055481 10406 raft_consensus.cc:3037] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:46.055477 10204 raft_consensus.cc:3037] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:46.057149 10406 raft_consensus.cc:2454] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04517afbb4348e4b6c5809f72306bdb in term 1.
I20260806 18:43:46.057149 10204 raft_consensus.cc:2454] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04517afbb4348e4b6c5809f72306bdb in term 1.
I20260806 18:43:46.057826 9892 leader_election.cc:302] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3eb9d04c5947788cfacfda47ab23ea, d04517afbb4348e4b6c5809f72306bdb; no voters:
I20260806 18:43:46.058153 10538 raft_consensus.cc:2781] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:46.058466 10538 raft_consensus.cc:686] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [term 1 LEADER]: Becoming Leader. State: Replica: d04517afbb4348e4b6c5809f72306bdb, State: Running, Role: LEADER
I20260806 18:43:46.058887 10538 consensus_queue.cc:237] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } }
I20260806 18:43:46.062933 9769 catalog_manager.cc:5495] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb reported cstate change: term changed from 0 to 1, leader changed from <none> to d04517afbb4348e4b6c5809f72306bdb (127.12.177.129). New cstate: current_term: 1 leader_uuid: "d04517afbb4348e4b6c5809f72306bdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04517afbb4348e4b6c5809f72306bdb" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 } health_report { overall_health: UNKNOWN } } }
I20260806 18:43:46.101951 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.098012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39216 (local address 127.12.177.129:35595)
0806 18:43:46.098161 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:46.098164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:46.098180 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:43:46.098276 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:46.098278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:46.098347 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:46.098444 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:46.098682 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.099215 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.100108 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.100422 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.100544 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.100919 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:46.101521 (+ 602us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:46.101667 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:46.101707 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 18:43:46.101780 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:43:46.109805 10406 raft_consensus.cc:1261] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 1 FOLLOWER]: Refusing update from remote peer d04517afbb4348e4b6c5809f72306bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:46.109805 10204 raft_consensus.cc:1261] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 1 FOLLOWER]: Refusing update from remote peer d04517afbb4348e4b6c5809f72306bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:46.111546 10538 consensus_queue.cc:1035] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3eb9d04c5947788cfacfda47ab23ea" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:46.111994 10541 consensus_queue.cc:1035] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "395cd4132faa4420abff19fa03af446d" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 18:43:46.119603 10071 tablet.cc:2369] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 18:43:46.122704 10546 mvcc.cc:205] Tried to move back new op lower bound from 7315627319733243904 to 7315627319540256768. Current Snapshot: MvccSnapshot[applied={T|T < 7315627319733243904}]
I20260806 18:43:46.123898 10548 mvcc.cc:205] Tried to move back new op lower bound from 7315627319733243904 to 7315627319540256768. Current Snapshot: MvccSnapshot[applied={T|T < 7315627319733243904}]
I20260806 18:43:46.133446 9770 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:46.133646 9770 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:46.137009 9770 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97fc8ab4df65430e9e1f8dd7441b855e: Sending DeleteTablet for 3 replicas of tablet 08d2c76ab46048e8b1ba3980c63ba54b
I20260806 18:43:46.138188 9974 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:46 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:39206
I20260806 18:43:46.138273 10371 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:46 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:55150
I20260806 18:43:46.138830 10174 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d2c76ab46048e8b1ba3980c63ba54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:46 UTC) from {username='kudu', principal='kudu/127.12.177.190@KRBTEST.COM'} at 127.0.0.1:34090
I20260806 18:43:46.139171 10562 tablet_replica.cc:330] T 08d2c76ab46048e8b1ba3980c63ba54b P d04517afbb4348e4b6c5809f72306bdb: stopping tablet replica
I20260806 18:43:46.139564 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 9866
I20260806 18:43:46.149067 10564 tablet_replica.cc:330] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: stopping tablet replica
I20260806 18:43:46.149719 10564 raft_consensus.cc:2229] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:46.150218 10564 raft_consensus.cc:2258] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:46.153960 10564 ts_tablet_manager.cc:1905] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:46.157617 10566 tablet_replica.cc:330] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: stopping tablet replica
I20260806 18:43:46.158217 10566 raft_consensus.cc:2229] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:46.158820 10566 raft_consensus.cc:2258] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:46.160216 10564 ts_tablet_manager.cc:1918] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:46.160459 10564 log.cc:1196] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/08d2c76ab46048e8b1ba3980c63ba54b
I20260806 18:43:46.160830 10566 ts_tablet_manager.cc:1905] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:46.161036 10564 ts_tablet_manager.cc:1939] T 08d2c76ab46048e8b1ba3980c63ba54b P 7a3eb9d04c5947788cfacfda47ab23ea: Deleting consensus metadata
I20260806 18:43:46.163833 10566 ts_tablet_manager.cc:1918] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:46.163853 9751 catalog_manager.cc:4841] TS 7a3eb9d04c5947788cfacfda47ab23ea (127.12.177.131:37697): tablet 08d2c76ab46048e8b1ba3980c63ba54b (table test-table [id=efbb9150d00045988cce3641a21d5b20]) successfully deleted
I20260806 18:43:46.164008 10566 log.cc:1196] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/08d2c76ab46048e8b1ba3980c63ba54b
I20260806 18:43:46.164346 10566 ts_tablet_manager.cc:1939] T 08d2c76ab46048e8b1ba3980c63ba54b P 395cd4132faa4420abff19fa03af446d: Deleting consensus metadata
I20260806 18:43:46.165939 9752 catalog_manager.cc:4841] TS 395cd4132faa4420abff19fa03af446d (127.12.177.130:45135): tablet 08d2c76ab46048e8b1ba3980c63ba54b (table test-table [id=efbb9150d00045988cce3641a21d5b20]) successfully deleted
W20260806 18:43:46.167917 9750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:35595 (error 108)
I20260806 18:43:46.168095 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 10078
I20260806 18:43:46.197415 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.178271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:35595 (local address 127.0.0.1:39220)
0806 18:43:46.197071 (+ 18800us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:46.197232 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:35595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18641}
W20260806 18:43:46.197711 9750 catalog_manager.cc:4584] TS d04517afbb4348e4b6c5809f72306bdb (127.12.177.129:35595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08d2c76ab46048e8b1ba3980c63ba54b: Network error: Client connection negotiation failed: client connection to 127.12.177.129:35595: connect: Connection refused (error 111)
I20260806 18:43:46.204583 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 10277
I20260806 18:43:46.223552 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 9724
2026-08-06T18:43:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2847 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T18:43:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:46Z Disabled control of system clock
I20260806 18:43:46.282642 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:41479
--webserver_interface=127.12.177.190
--webserver_port=0
--builtin_ntp_servers=127.12.177.148:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:41479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:46.416864 10571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:46.417285 10571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:46.417412 10571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:46.421813 10571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:46.421948 10571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:46.421974 10571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:46.422005 10571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:46.422041 10571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:46.427345 10571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:41479
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:41479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:46.428655 10571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:46.430210 10571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:46.439817 10580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:46.439817 10581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:46.439823 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:46.440063 10571 server_base.cc:1034] running on GCE node
I20260806 18:43:46.440964 10571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:46.442392 10571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:46.443641 10571 hybrid_clock.cc:648] HybridClock initialized: now 1786041826443604 us; error 52 us; skew 500 ppm
I20260806 18:43:46.445992 10571 webserver.cc:460] Webserver started at http://127.12.177.190:44677/ using document root <none> and password file <none>
I20260806 18:43:46.446693 10571 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:46.446774 10571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:46.446985 10571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:46.449676 10571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "b8ed86854f054fa5962eb4c6b3830a95"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "3e5d51d53d25cd04effafb6a6fd2ed86"
server_key_iv: "a30b40135b282fdaf090c89841438474"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.450352 10571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "b8ed86854f054fa5962eb4c6b3830a95"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "3e5d51d53d25cd04effafb6a6fd2ed86"
server_key_iv: "a30b40135b282fdaf090c89841438474"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.456028 10571 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:43:46.458935 10602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.460376 10571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:43:46.460502 10571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "b8ed86854f054fa5962eb4c6b3830a95"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "3e5d51d53d25cd04effafb6a6fd2ed86"
server_key_iv: "a30b40135b282fdaf090c89841438474"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.460611 10571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:46.476956 10571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:46.477824 10571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:46.478009 10571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:46.486059 10685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:41479 every 8 connection(s)
I20260806 18:43:46.486034 10571 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:41479
I20260806 18:43:46.487265 10571 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:46.490772 10686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:46.493737 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 10571
I20260806 18:43:46.493880 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:46.494396 12998 external_mini_cluster.cc:1428] Setting key 14777bff170fe72ec5d0d14045f8c7ac
I20260806 18:43:46.497651 10686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: Bootstrap starting.
I20260806 18:43:46.500145 10686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:46.501150 10686 log.cc:824] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:46.503517 10686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: No bootstrap required, opened a new log
I20260806 18:43:46.505861 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.496124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49556 (local address 127.12.177.190:41479)
0806 18:43:46.496915 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:46.496943 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:46.496992 (+ 49us) server_negotiation.cc:407] Connection header received
0806 18:43:46.497776 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:46.497826 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:46.498278 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:46.498804 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:46.499343 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.500573 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.501825 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.502406 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.502626 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.503674 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:46.503682 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:46.503703 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:46.504180 (+ 477us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:46.504270 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:46.504296 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:46.504425 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:46.504567 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 18:43:46.504889 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":169,"threads_started":1}
I20260806 18:43:46.508011 10686 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } }
I20260806 18:43:46.508306 10686 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:46.508399 10686 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ed86854f054fa5962eb4c6b3830a95, State: Initialized, Role: FOLLOWER
I20260806 18:43:46.508903 10686 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } }
I20260806 18:43:46.509064 10686 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:46.509110 10686 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:46.509186 10686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:46.510298 10686 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } }
I20260806 18:43:46.510645 10686 leader_election.cc:302] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8ed86854f054fa5962eb4c6b3830a95; no voters:
I20260806 18:43:46.510941 10686 leader_election.cc:288] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:46.511096 10693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:46.511351 10693 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [term 1 LEADER]: Becoming Leader. State: Replica: b8ed86854f054fa5962eb4c6b3830a95, State: Running, Role: LEADER
I20260806 18:43:46.511686 10693 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } }
I20260806 18:43:46.512317 10686 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:46.514109 10698 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8ed86854f054fa5962eb4c6b3830a95. Latest consensus state: current_term: 1 leader_uuid: "b8ed86854f054fa5962eb4c6b3830a95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } } }
I20260806 18:43:46.514293 10698 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:46.514611 10695 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8ed86854f054fa5962eb4c6b3830a95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8ed86854f054fa5962eb4c6b3830a95" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 41479 } } }
I20260806 18:43:46.514730 10695 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95 [sys.catalog]: This master's current role is: LEADER
W20260806 18:43:46.517937 10716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:43:46.518049 10716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:43:46.518124 10712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:46.518867 10712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:46.525048 10712 catalog_manager.cc:1347] Generated new cluster ID: bf6dbee5e6a34006bb2633f4a6e1aeb8
I20260806 18:43:46.525154 10712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:46.536926 10712 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:46.538081 10712 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:46.551406 10712 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: Generated new TSK 0
I20260806 18:43:46.552521 10712 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:46.565209 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.129:0
--local_ip_for_outbound_sockets=127.12.177.129
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--builtin_ntp_servers=127.12.177.148:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 18:43:46.699671 10721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:46.700019 10721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:46.700062 10721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:46.704559 10721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:46.704643 10721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:46.704704 10721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.129
I20260806 18:43:46.710274 10721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.177.129
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.129
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:46.711576 10721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:46.713260 10721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:46.725660 10732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:46.725832 10721 server_base.cc:1034] running on GCE node
W20260806 18:43:46.725687 10728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:46.726042 10729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:46.726516 10721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:46.727298 10721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:46.728513 10721 hybrid_clock.cc:648] HybridClock initialized: now 1786041826728498 us; error 37 us; skew 500 ppm
I20260806 18:43:46.731143 10721 webserver.cc:460] Webserver started at http://127.12.177.129:45527/ using document root <none> and password file <none>
I20260806 18:43:46.731812 10721 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:46.731884 10721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:46.732161 10721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:46.734622 10721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data/instance:
uuid: "ad45a81920714fc0838bd3e4ca5b5971"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "b85943ada14fbff4a6aa23eb50ceb4c2"
server_key_iv: "2e6d75b51b30c7f2309126d44064a044"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.735354 10721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance:
uuid: "ad45a81920714fc0838bd3e4ca5b5971"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "b85943ada14fbff4a6aa23eb50ceb4c2"
server_key_iv: "2e6d75b51b30c7f2309126d44064a044"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.739837 10721 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:46.742897 10739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.744598 10721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:43:46.744758 10721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal
uuid: "ad45a81920714fc0838bd3e4ca5b5971"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "b85943ada14fbff4a6aa23eb50ceb4c2"
server_key_iv: "2e6d75b51b30c7f2309126d44064a044"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.744897 10721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:46.759747 10721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:46.760637 10721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:46.760879 10721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:46.761644 10721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:46.762816 10721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:46.762873 10721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.762950 10721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:46.762981 10721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.773659 10721 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.129:45959
I20260806 18:43:46.773746 10920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.129:45959 every 8 connection(s)
I20260806 18:43:46.774808 10721 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/data/info.pb
I20260806 18:43:46.784684 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 10721
I20260806 18:43:46.784909 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-0/wal/instance
I20260806 18:43:46.785311 12998 external_mini_cluster.cc:1428] Setting key 927369878b6595de8c8009c17ae49ee8
I20260806 18:43:46.787207 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.777143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:47085 (local address 127.12.177.190:41479)
0806 18:43:46.777319 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:46.777324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:46.778788 (+ 1464us) server_negotiation.cc:407] Connection header received
0806 18:43:46.780387 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:46.780391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:46.780452 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:46.780556 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:46.781888 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.782463 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.783943 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.784589 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.784731 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.786569 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:46.786573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:46.786576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:46.786591 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:46.786616 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:46.786626 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:46.786723 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:46.786952 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 18:43:46.787043 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 18:43:46.787786 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.130:0
--local_ip_for_outbound_sockets=127.12.177.130
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--builtin_ntp_servers=127.12.177.148:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:46.788543 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:46.777726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41479 (local address 127.12.177.129:47085)
0806 18:43:46.778555 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:46.778620 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:46.780077 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:46.780875 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:46.780884 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:46.780991 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:46.781663 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.781679 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.782642 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.782645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.783735 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:46.783749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:46.784975 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:46.784981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:46.785302 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:46.786154 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:46.786156 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:46.786233 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:46.786352 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:46.786744 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:46.786761 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:46.786768 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 18:43:46.786934 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 18:43:46.787358 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":169,"threads_started":1}
I20260806 18:43:46.790369 10921 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41479
I20260806 18:43:46.790772 10921 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:46.791477 10921 heartbeater.cc:511] Master 127.12.177.190:41479 requested a full tablet report, sending...
I20260806 18:43:46.793596 10628 ts_manager.cc:194] Registered new tserver with Master: ad45a81920714fc0838bd3e4ca5b5971 (127.12.177.129:45959)
I20260806 18:43:46.795047 10628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.129:47085
W20260806 18:43:46.922592 10924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:46.922940 10924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:46.923025 10924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:46.927910 10924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:46.928017 10924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:46.928117 10924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.130
I20260806 18:43:46.934029 10924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.177.130
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.130
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:46.935434 10924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:46.937070 10924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:46.948921 10932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:46.948918 10941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:46.948918 10931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:46.949332 10924 server_base.cc:1034] running on GCE node
I20260806 18:43:46.949963 10924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:46.950944 10924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:46.952251 10924 hybrid_clock.cc:648] HybridClock initialized: now 1786041826952232 us; error 39 us; skew 500 ppm
I20260806 18:43:46.955199 10924 webserver.cc:460] Webserver started at http://127.12.177.130:34817/ using document root <none> and password file <none>
I20260806 18:43:46.955921 10924 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:46.956041 10924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:46.956318 10924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:46.959141 10924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data/instance:
uuid: "a11b8356a07e4325a5f00396a70216c6"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "51feded5953e90bdcdca973a60c22586"
server_key_iv: "873135e94bba4a9e405caa1c226bcf2b"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.959926 10924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance:
uuid: "a11b8356a07e4325a5f00396a70216c6"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "51feded5953e90bdcdca973a60c22586"
server_key_iv: "873135e94bba4a9e405caa1c226bcf2b"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.965685 10924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 18:43:46.969683 10948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.971617 10924 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:43:46.971817 10924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal
uuid: "a11b8356a07e4325a5f00396a70216c6"
format_stamp: "Formatted at 2026-08-06 18:43:46 on dist-test-slave-j2vl"
server_key: "51feded5953e90bdcdca973a60c22586"
server_key_iv: "873135e94bba4a9e405caa1c226bcf2b"
server_key_version: "encryptionkey@0"
I20260806 18:43:46.971985 10924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:46.993741 10924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:46.994681 10924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:46.994956 10924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:46.995721 10924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:46.996969 10924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:46.997049 10924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:46.997124 10924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:46.997169 10924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:47.012373 10924 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.130:46757
I20260806 18:43:47.012427 11132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.130:46757 every 8 connection(s)
I20260806 18:43:47.013850 10924 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/data/info.pb
I20260806 18:43:47.019748 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 10924
I20260806 18:43:47.019877 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal/instance
I20260806 18:43:47.020291 12998 external_mini_cluster.cc:1428] Setting key 7bd4f4ffbf14ba97e7e0bd104ae80fac
I20260806 18:43:47.022513 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.177.131:0
--local_ip_for_outbound_sockets=127.12.177.131
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--builtin_ntp_servers=127.12.177.148:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 18:43:47.027489 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.016718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.130:51571 (local address 127.12.177.190:41479)
0806 18:43:47.016994 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.016999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.018711 (+ 1712us) server_negotiation.cc:407] Connection header received
0806 18:43:47.020544 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.020549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.020622 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.020719 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:47.022089 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.022636 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.024118 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.024658 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.024786 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.026876 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:47.026879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:47.026882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:47.026899 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:47.026926 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:47.026935 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:47.027031 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.027231 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.027323 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260806 18:43:47.028709 11141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.017228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41479 (local address 127.12.177.130:51571)
0806 18:43:47.018445 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.018500 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.020185 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.020952 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.020960 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.021069 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:47.021773 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.021790 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.022870 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.022874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.023934 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.023962 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.024923 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.024930 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.025237 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.026351 (+ 1114us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:47.026352 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:47.026532 (+ 180us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:47.026629 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:47.027037 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:47.027051 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:47.027061 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.027212 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.027602 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":199,"threads_started":1}
I20260806 18:43:47.030638 11137 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41479
I20260806 18:43:47.031116 11137 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:47.031824 11137 heartbeater.cc:511] Master 127.12.177.190:41479 requested a full tablet report, sending...
I20260806 18:43:47.033238 10628 ts_manager.cc:194] Registered new tserver with Master: a11b8356a07e4325a5f00396a70216c6 (127.12.177.130:46757)
I20260806 18:43:47.033955 10628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.130:51571
W20260806 18:43:47.159441 11142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:47.159826 11142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:47.159914 11142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:47.164496 11142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:47.164603 11142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:47.164700 11142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.177.131
I20260806 18:43:47.170243 11142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.177.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.177.131
--webserver_port=0
--tserver_master_addrs=127.12.177.190:41479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.177.131
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:47.171633 11142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:47.173182 11142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:47.184533 11151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:47.184540 11152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:47.184540 11155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:47.184935 11142 server_base.cc:1034] running on GCE node
I20260806 18:43:47.185549 11142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:47.186291 11142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:47.187511 11142 hybrid_clock.cc:648] HybridClock initialized: now 1786041827187492 us; error 33 us; skew 500 ppm
I20260806 18:43:47.189751 11142 webserver.cc:460] Webserver started at http://127.12.177.131:33499/ using document root <none> and password file <none>
I20260806 18:43:47.190418 11142 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:47.190523 11142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:47.190945 11142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:47.193423 11142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data/instance:
uuid: "930df7ab8cb445c1bbfd2b880b8f6821"
format_stamp: "Formatted at 2026-08-06 18:43:47 on dist-test-slave-j2vl"
server_key: "982d711e25f0c9c1a642293499a61441"
server_key_iv: "9a4aa85cd93dfb183df29c585fb75623"
server_key_version: "encryptionkey@0"
I20260806 18:43:47.194097 11142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance:
uuid: "930df7ab8cb445c1bbfd2b880b8f6821"
format_stamp: "Formatted at 2026-08-06 18:43:47 on dist-test-slave-j2vl"
server_key: "982d711e25f0c9c1a642293499a61441"
server_key_iv: "9a4aa85cd93dfb183df29c585fb75623"
server_key_version: "encryptionkey@0"
I20260806 18:43:47.198652 11142 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:43:47.201709 11167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:47.203146 11142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:47.203315 11142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal
uuid: "930df7ab8cb445c1bbfd2b880b8f6821"
format_stamp: "Formatted at 2026-08-06 18:43:47 on dist-test-slave-j2vl"
server_key: "982d711e25f0c9c1a642293499a61441"
server_key_iv: "9a4aa85cd93dfb183df29c585fb75623"
server_key_version: "encryptionkey@0"
I20260806 18:43:47.203459 11142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:47.220217 11142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:47.221113 11142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:47.221422 11142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:47.222841 11142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 18:43:47.224117 11142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 18:43:47.224216 11142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:47.224299 11142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 18:43:47.224352 11142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:47.237797 11142 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.131:42323
I20260806 18:43:47.237859 11345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.131:42323 every 8 connection(s)
I20260806 18:43:47.238873 11142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/data/info.pb
I20260806 18:43:47.242890 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 11142
I20260806 18:43:47.243077 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal/instance
I20260806 18:43:47.243392 12998 external_mini_cluster.cc:1428] Setting key b2075b340fdae3eb8c68031eb38c3e6b
I20260806 18:43:47.252483 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.241385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.131:52169 (local address 127.12.177.190:41479)
0806 18:43:47.241588 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.241595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.243016 (+ 1421us) server_negotiation.cc:407] Connection header received
0806 18:43:47.245327 (+ 2311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.245331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.245430 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.245514 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:47.247124 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.247668 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.249705 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.250057 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.250139 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.251887 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:47.251891 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:47.251894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:47.251912 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:47.251938 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:47.251948 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:47.251994 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.252224 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.252305 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:43:47.254408 11351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.241852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:41479 (local address 127.12.177.131:52169)
0806 18:43:47.242811 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.242879 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.245041 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.245880 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.245892 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.246038 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:43:47.246925 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.246952 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.247826 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.247832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.249512 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.249528 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.250414 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.250417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.250670 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.251494 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 18:43:47.251497 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:43:47.251563 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 18:43:47.251668 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:43:47.252060 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:43:47.252069 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:43:47.252075 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.252825 (+ 750us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.253201 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":167,"threads_started":1}
I20260806 18:43:47.255967 11347 heartbeater.cc:347] Connected to a master server at 127.12.177.190:41479
I20260806 18:43:47.256327 11347 heartbeater.cc:464] Registering TS with master...
I20260806 18:43:47.257064 11347 heartbeater.cc:511] Master 127.12.177.190:41479 requested a full tablet report, sending...
I20260806 18:43:47.258937 10628 ts_manager.cc:194] Registered new tserver with Master: 930df7ab8cb445c1bbfd2b880b8f6821 (127.12.177.131:42323)
I20260806 18:43:47.259814 12998 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 18:43:47.259864 10628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.177.131:52169
I20260806 18:43:47.270787 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.263103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49564 (local address 127.12.177.190:41479)
0806 18:43:47.263283 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.263288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.263453 (+ 165us) server_negotiation.cc:407] Connection header received
0806 18:43:47.263644 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.263647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.263708 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.263808 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:47.264772 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.265819 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.267404 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.267906 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.268335 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.270062 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:47.270070 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:47.270074 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:47.270097 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:47.270132 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:47.270148 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:47.270258 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.270459 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.270573 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 18:43:47.275169 10628 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 18:43:47.279702 10628 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 18:43:47.301182 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.294806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:46757 (local address 127.0.0.1:44214)
0806 18:43:47.295202 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.295217 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.295298 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.296199 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.296202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.296221 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:47.296332 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.296342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297566 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.297570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.299077 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.299091 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.300410 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.300422 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.300574 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.300662 (+ 88us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.300768 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.300982 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":25,"thread_start_us":132,"threads_started":1}
I20260806 18:43:47.301788 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.293535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:42323 (local address 127.0.0.1:46176)
0806 18:43:47.294584 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.294651 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.294829 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.295813 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.295820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.295860 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:47.296206 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.296215 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297817 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.297820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.299448 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.299464 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.300781 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.300787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.300910 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.300947 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.301012 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.301109 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":334,"spinlock_wait_cycles":7936,"thread_start_us":103,"threads_started":1}
I20260806 18:43:47.302084 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.293700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45959 (local address 127.0.0.1:52658)
0806 18:43:47.294586 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.294652 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.294990 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.295813 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.295820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.295858 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:47.296206 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.296215 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297817 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.297820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.299398 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.299408 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.301646 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.301650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.301744 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.301767 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.301844 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.301940 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":282,"spinlock_wait_cycles":6656,"thread_start_us":93,"threads_started":1}
I20260806 18:43:47.302721 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.293694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46176 (local address 127.12.177.131:42323)
0806 18:43:47.295202 (+ 1508us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.295214 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.295239 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:43:47.295311 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.295316 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.295468 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.295614 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:47.296363 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297666 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.299628 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.300613 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.301735 (+ 1122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.302320 (+ 585us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.302392 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.302539 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1378,"thread_start_us":152,"threads_started":1}
I20260806 18:43:47.302894 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.293891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52658 (local address 127.12.177.129:45959)
0806 18:43:47.294275 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.294282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.294901 (+ 619us) server_negotiation.cc:407] Connection header received
0806 18:43:47.295176 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.295184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.295434 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.295616 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:47.296364 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297667 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.299545 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.300510 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.301236 (+ 726us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.301578 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.302601 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.302738 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":92,"threads_started":1}
I20260806 18:43:47.303161 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.295334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44214 (local address 127.12.177.130:46757)
0806 18:43:47.295701 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.295714 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.295739 (+ 25us) server_negotiation.cc:407] Connection header received
0806 18:43:47.295860 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.295864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.296060 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.296224 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:47.296476 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.297437 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.299244 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.300141 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.302124 (+ 1983us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.302452 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.302830 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.302974 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":156,"threads_started":1}
I20260806 18:43:47.306452 11032 tablet_service.cc:1467] Processing CreateTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd (DEFAULT_TABLE table=test-table [id=4db26cca3241424ea819656cdc93d403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:47.306454 10818 tablet_service.cc:1467] Processing CreateTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd (DEFAULT_TABLE table=test-table [id=4db26cca3241424ea819656cdc93d403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:47.308131 11032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8216e41ffdd94cf1b484d5e2c47953bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:47.308171 10818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8216e41ffdd94cf1b484d5e2c47953bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:47.307876 11244 tablet_service.cc:1467] Processing CreateTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd (DEFAULT_TABLE table=test-table [id=4db26cca3241424ea819656cdc93d403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 18:43:47.309131 11244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8216e41ffdd94cf1b484d5e2c47953bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:47.317574 11376 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Bootstrap starting.
I20260806 18:43:47.318697 11377 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: Bootstrap starting.
I20260806 18:43:47.320529 11376 tablet_bootstrap.cc:654] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:47.321200 11377 tablet_bootstrap.cc:654] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:47.321663 11376 log.cc:824] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:47.322021 11375 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Bootstrap starting.
I20260806 18:43:47.322463 11377 log.cc:824] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:47.324355 11376 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: No bootstrap required, opened a new log
I20260806 18:43:47.324608 11377 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: No bootstrap required, opened a new log
I20260806 18:43:47.324633 11376 ts_tablet_manager.cc:1397] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 18:43:47.324815 11377 ts_tablet_manager.cc:1397] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 18:43:47.326519 11375 tablet_bootstrap.cc:654] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:47.327761 11375 log.cc:824] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:47.329684 11376 raft_consensus.cc:348] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.330052 11376 raft_consensus.cc:374] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:47.330106 11376 raft_consensus.cc:729] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930df7ab8cb445c1bbfd2b880b8f6821, State: Initialized, Role: FOLLOWER
I20260806 18:43:47.329969 11377 raft_consensus.cc:348] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.330236 11377 raft_consensus.cc:374] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:47.330288 11377 raft_consensus.cc:729] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad45a81920714fc0838bd3e4ca5b5971, State: Initialized, Role: FOLLOWER
I20260806 18:43:47.330734 11377 consensus_queue.cc:260] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.330734 11376 consensus_queue.cc:260] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.331642 11347 heartbeater.cc:503] Master 127.12.177.190:41479 was elected leader, sending a full tablet report...
I20260806 18:43:47.332013 11376 ts_tablet_manager.cc:1428] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 18:43:47.332013 11377 ts_tablet_manager.cc:1428] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 18:43:47.332461 10921 heartbeater.cc:503] Master 127.12.177.190:41479 was elected leader, sending a full tablet report...
I20260806 18:43:47.334962 11375 tablet_bootstrap.cc:492] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: No bootstrap required, opened a new log
I20260806 18:43:47.335274 11375 ts_tablet_manager.cc:1397] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260806 18:43:47.339821 11375 raft_consensus.cc:348] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.340132 11375 raft_consensus.cc:374] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:47.340217 11375 raft_consensus.cc:729] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11b8356a07e4325a5f00396a70216c6, State: Initialized, Role: FOLLOWER
I20260806 18:43:47.340720 11375 consensus_queue.cc:260] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.341686 11137 heartbeater.cc:503] Master 127.12.177.190:41479 was elected leader, sending a full tablet report...
I20260806 18:43:47.342072 11375 ts_tablet_manager.cc:1428] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 18:43:47.364643 11393 raft_consensus.cc:482] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 18:43:47.364917 11393 raft_consensus.cc:504] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.367393 11393 leader_election.cc:288] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930df7ab8cb445c1bbfd2b880b8f6821 (127.12.177.131:42323), a11b8356a07e4325a5f00396a70216c6 (127.12.177.130:46757)
I20260806 18:43:47.371793 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.366903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.131:42323 (local address 127.12.177.129:60019)
0806 18:43:47.367269 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.367286 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.367433 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.367744 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.367750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.367777 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:47.367992 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.368002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.369038 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.369042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.370565 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.370578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.371419 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.371422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.371491 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.371512 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.371563 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.371625 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":38,"thread_start_us":171,"threads_started":1}
I20260806 18:43:47.371836 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.366988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:60019 (local address 127.12.177.131:42323)
0806 18:43:47.367178 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.367184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.367395 (+ 211us) server_negotiation.cc:407] Connection header received
0806 18:43:47.367578 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.367582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.367639 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.367740 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:47.368152 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.368892 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.370735 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.371197 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.371293 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.371381 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.371611 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.371700 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 18:43:47.372686 11400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.367652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.130:46757 (local address 127.12.177.129:53639)
0806 18:43:47.368039 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.368053 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:43:47.368227 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:43:47.368687 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:43:47.368691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:43:47.368713 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 18:43:47.368890 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.368900 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.370165 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.370169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.371257 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:43:47.371268 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.372194 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.372198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:43:47.372341 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.372369 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 18:43:47.372458 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 18:43:47.372530 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":49,"thread_start_us":119,"threads_started":1}
I20260806 18:43:47.372696 11275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8216e41ffdd94cf1b484d5e2c47953bd" candidate_uuid: "ad45a81920714fc0838bd3e4ca5b5971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" is_pre_election: true
I20260806 18:43:47.372725 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.367844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.177.129:53639 (local address 127.12.177.130:46757)
0806 18:43:47.368001 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.368006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.368143 (+ 137us) server_negotiation.cc:407] Connection header received
0806 18:43:47.368372 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.368377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.368451 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.368511 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 18:43:47.369066 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.369979 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.371409 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.371994 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.372140 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.372196 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.372531 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.372619 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 18:43:47.373096 11275 raft_consensus.cc:2454] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad45a81920714fc0838bd3e4ca5b5971 in term 0.
I20260806 18:43:47.373656 11060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8216e41ffdd94cf1b484d5e2c47953bd" candidate_uuid: "ad45a81920714fc0838bd3e4ca5b5971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11b8356a07e4325a5f00396a70216c6" is_pre_election: true
I20260806 18:43:47.373983 11060 raft_consensus.cc:2454] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad45a81920714fc0838bd3e4ca5b5971 in term 0.
I20260806 18:43:47.373824 10743 leader_election.cc:302] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930df7ab8cb445c1bbfd2b880b8f6821, ad45a81920714fc0838bd3e4ca5b5971; no voters:
I20260806 18:43:47.374646 11393 raft_consensus.cc:2781] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 18:43:47.374828 11393 raft_consensus.cc:482] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 18:43:47.374882 11393 raft_consensus.cc:3037] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:47.376122 11393 raft_consensus.cc:504] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.376508 11393 leader_election.cc:288] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [CANDIDATE]: Term 1 election: Requested vote from peers 930df7ab8cb445c1bbfd2b880b8f6821 (127.12.177.131:42323), a11b8356a07e4325a5f00396a70216c6 (127.12.177.130:46757)
I20260806 18:43:47.377054 11060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8216e41ffdd94cf1b484d5e2c47953bd" candidate_uuid: "ad45a81920714fc0838bd3e4ca5b5971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11b8356a07e4325a5f00396a70216c6"
I20260806 18:43:47.377071 11275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8216e41ffdd94cf1b484d5e2c47953bd" candidate_uuid: "ad45a81920714fc0838bd3e4ca5b5971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930df7ab8cb445c1bbfd2b880b8f6821"
I20260806 18:43:47.377238 11275 raft_consensus.cc:3037] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:47.377223 11060 raft_consensus.cc:3037] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:47.378564 11275 raft_consensus.cc:2454] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad45a81920714fc0838bd3e4ca5b5971 in term 1.
I20260806 18:43:47.378908 11060 raft_consensus.cc:2454] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad45a81920714fc0838bd3e4ca5b5971 in term 1.
I20260806 18:43:47.378985 10743 leader_election.cc:302] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930df7ab8cb445c1bbfd2b880b8f6821, ad45a81920714fc0838bd3e4ca5b5971; no voters:
I20260806 18:43:47.379189 11393 raft_consensus.cc:2781] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:47.379557 11393 raft_consensus.cc:686] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 1 LEADER]: Becoming Leader. State: Replica: ad45a81920714fc0838bd3e4ca5b5971, State: Running, Role: LEADER
I20260806 18:43:47.380016 11393 consensus_queue.cc:237] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } }
I20260806 18:43:47.383673 10626 catalog_manager.cc:5495] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad45a81920714fc0838bd3e4ca5b5971 (127.12.177.129). New cstate: current_term: 1 leader_uuid: "ad45a81920714fc0838bd3e4ca5b5971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad45a81920714fc0838bd3e4ca5b5971" member_type: VOTER last_known_addr { host: "127.12.177.129" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260806 18:43:47.404946 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.401045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.12.177.129:45959)
0806 18:43:47.401206 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:47.401211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:47.401229 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:43:47.401392 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:47.401396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:47.401469 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:47.401593 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:43:47.401862 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.402420 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.403330 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:47.403563 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:47.403681 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:47.404034 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:43:47.404515 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:43:47.404659 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:47.404702 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 18:43:47.404769 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 18:43:47.412061 11275 raft_consensus.cc:1261] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 1 FOLLOWER]: Refusing update from remote peer ad45a81920714fc0838bd3e4ca5b5971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:47.412061 11060 raft_consensus.cc:1261] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 1 FOLLOWER]: Refusing update from remote peer ad45a81920714fc0838bd3e4ca5b5971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:43:47.412925 11402 consensus_queue.cc:1035] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930df7ab8cb445c1bbfd2b880b8f6821" member_type: VOTER last_known_addr { host: "127.12.177.131" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:47.413178 11393 consensus_queue.cc:1035] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11b8356a07e4325a5f00396a70216c6" member_type: VOTER last_known_addr { host: "127.12.177.130" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:43:47.423415 11406 mvcc.cc:205] Tried to move back new op lower bound from 7315627325071077376 to 7315627324951990272. Current Snapshot: MvccSnapshot[applied={T|T < 7315627325071077376}]
I20260806 18:43:47.435985 10627 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:47.436180 10627 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 18:43:47.439057 10627 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8ed86854f054fa5962eb4c6b3830a95: Sending DeleteTablet for 3 replicas of tablet 8216e41ffdd94cf1b484d5e2c47953bd
I20260806 18:43:47.440124 11244 tablet_service.cc:1514] Processing DeleteTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:47 UTC) from {username='slave'} at 127.0.0.1:46176
I20260806 18:43:47.440176 10818 tablet_service.cc:1514] Processing DeleteTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:47 UTC) from {username='slave'} at 127.0.0.1:52658
I20260806 18:43:47.440774 11419 tablet_replica.cc:330] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: stopping tablet replica
I20260806 18:43:47.440773 11032 tablet_service.cc:1514] Processing DeleteTablet for tablet 8216e41ffdd94cf1b484d5e2c47953bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 18:43:47 UTC) from {username='slave'} at 127.0.0.1:44214
I20260806 18:43:47.440908 11422 tablet_replica.cc:330] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971: stopping tablet replica
I20260806 18:43:47.441279 11422 raft_consensus.cc:2229] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 1 LEADER]: Raft consensus shutting down.
I20260806 18:43:47.441279 11419 raft_consensus.cc:2229] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:47.441763 11419 raft_consensus.cc:2258] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:47.441756 11422 raft_consensus.cc:2258] T 8216e41ffdd94cf1b484d5e2c47953bd P ad45a81920714fc0838bd3e4ca5b5971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:47.442122 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 10721
I20260806 18:43:47.457252 11423 tablet_replica.cc:330] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: stopping tablet replica
I20260806 18:43:47.457931 11423 raft_consensus.cc:2229] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 18:43:47.458459 11423 raft_consensus.cc:2258] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 18:43:47.462103 11423 ts_tablet_manager.cc:1905] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:47.466538 11423 ts_tablet_manager.cc:1918] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:47.466689 11423 log.cc:1196] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-1/wal/wals/8216e41ffdd94cf1b484d5e2c47953bd
I20260806 18:43:47.467041 11423 ts_tablet_manager.cc:1939] T 8216e41ffdd94cf1b484d5e2c47953bd P a11b8356a07e4325a5f00396a70216c6: Deleting consensus metadata
I20260806 18:43:47.468226 11419 ts_tablet_manager.cc:1905] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 18:43:47.468657 10607 catalog_manager.cc:4841] TS a11b8356a07e4325a5f00396a70216c6 (127.12.177.130:46757): tablet 8216e41ffdd94cf1b484d5e2c47953bd (table test-table [id=4db26cca3241424ea819656cdc93d403]) successfully deleted
I20260806 18:43:47.470775 11419 ts_tablet_manager.cc:1918] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 18:43:47.470907 11419 log.cc:1196] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Deleting WAL directory at /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786041540454168-12998-0/minicluster-data/ts-2/wal/wals/8216e41ffdd94cf1b484d5e2c47953bd
I20260806 18:43:47.471216 11419 ts_tablet_manager.cc:1939] T 8216e41ffdd94cf1b484d5e2c47953bd P 930df7ab8cb445c1bbfd2b880b8f6821: Deleting consensus metadata
I20260806 18:43:47.472442 10610 catalog_manager.cc:4841] TS 930df7ab8cb445c1bbfd2b880b8f6821 (127.12.177.131:42323): tablet 8216e41ffdd94cf1b484d5e2c47953bd (table test-table [id=4db26cca3241424ea819656cdc93d403]) successfully deleted
W20260806 18:43:47.473455 10607 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.177.129:45959 (error 108)
I20260806 18:43:47.474334 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 10924
I20260806 18:43:47.474684 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:47.474324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.129:45959 (local address 127.0.0.1:52668)
0806 18:43:47.474492 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 18:43:47.474576 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 18:43:47.481848 10607 catalog_manager.cc:4584] TS ad45a81920714fc0838bd3e4ca5b5971 (127.12.177.129:45959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8216e41ffdd94cf1b484d5e2c47953bd: Network error: Client connection negotiation failed: client connection to 127.12.177.129:45959: connect: Connection refused (error 111)
I20260806 18:43:47.497136 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 11142
I20260806 18:43:47.509542 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 10571
2026-08-06T18:43:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1277 ms)
[----------] 6 tests from EncryptionPolicyTest (12983 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:47 dist-test-slave-j2vl krb5kdc[11433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:47 dist-test-slave-j2vl krb5kdc[11433](info): set up 2 sockets
Aug 06 18:43:47 dist-test-slave-j2vl krb5kdc[11433](info): commencing operation
krb5kdc: starting...
W20260806 18:43:48.838915 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:48 dist-test-slave-j2vl krb5kdc[11433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:48.993796 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:49.123225 11452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:49.123631 11452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:49.123724 11452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:49.128089 11452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:49.128223 11452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:49.128261 11452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:49.128304 11452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:49.128337 11452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:49.136652 11452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34823
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:49.138125 11452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:49.139562 11452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:49.151554 11473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:49.151602 11469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:49.151712 11466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:49.152350 11452 server_base.cc:1034] running on GCE node
I20260806 18:43:49.153682 11452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:49.155364 11452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:49.156638 11452 hybrid_clock.cc:648] HybridClock initialized: now 1786041829156603 us; error 57 us; skew 500 ppm
Aug 06 18:43:49 dist-test-slave-j2vl krb5kdc[11433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041829, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:49.160768 11452 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:49.162128 11452 webserver.cc:460] Webserver started at http://127.0.0.1:41587/ using document root <none> and password file <none>
I20260806 18:43:49.162833 11452 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:49.162949 11452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:49.163226 11452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:49.165894 11452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "b202f096955746b99d3625794b6d5210"
format_stamp: "Formatted at 2026-08-06 18:43:49 on dist-test-slave-j2vl"
server_key: "38335f80f6f7d05049aa74533881aada"
server_key_iv: "929c17fdd88c5d9071b40705fe892f5c"
server_key_version: "encryptionkey@0"
I20260806 18:43:49.166630 11452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "b202f096955746b99d3625794b6d5210"
format_stamp: "Formatted at 2026-08-06 18:43:49 on dist-test-slave-j2vl"
server_key: "38335f80f6f7d05049aa74533881aada"
server_key_iv: "929c17fdd88c5d9071b40705fe892f5c"
server_key_version: "encryptionkey@0"
I20260806 18:43:49.172359 11452 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:43:49.175825 11483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:49.177799 11452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 18:43:49.178122 11452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "b202f096955746b99d3625794b6d5210"
format_stamp: "Formatted at 2026-08-06 18:43:49 on dist-test-slave-j2vl"
server_key: "38335f80f6f7d05049aa74533881aada"
server_key_iv: "929c17fdd88c5d9071b40705fe892f5c"
server_key_version: "encryptionkey@0"
I20260806 18:43:49.178298 11452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:49.198891 11452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:49.204134 11452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:49.204408 11452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:49.213014 11452 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34823
I20260806 18:43:49.213121 11565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34823 every 8 connection(s)
I20260806 18:43:49.214239 11452 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:49.217552 11566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:49.223944 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 11452
I20260806 18:43:49.224125 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:49.224431 12998 external_mini_cluster.cc:1428] Setting key 121975aadcddfa7a63805e7912ab80f0
I20260806 18:43:49.224437 11566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: Bootstrap starting.
I20260806 18:43:49.227481 11566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:49.228371 11566 log.cc:824] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:49.230989 11566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: No bootstrap required, opened a new log
Aug 06 18:43:49 dist-test-slave-j2vl krb5kdc[11433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 18:43:49.235664 11566 raft_consensus.cc:348] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260806 18:43:49.235988 11566 raft_consensus.cc:374] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:49.236078 11566 raft_consensus.cc:729] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b202f096955746b99d3625794b6d5210, State: Initialized, Role: FOLLOWER
I20260806 18:43:49.236644 11566 consensus_queue.cc:260] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260806 18:43:49.236829 11566 raft_consensus.cc:388] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:49.236927 11566 raft_consensus.cc:482] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:49.237262 11566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:49.239001 11566 raft_consensus.cc:504] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260806 18:43:49.239471 11566 leader_election.cc:302] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b202f096955746b99d3625794b6d5210; no voters:
I20260806 18:43:49.239974 11566 leader_election.cc:288] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:49.240100 11576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:49.240406 11576 raft_consensus.cc:686] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [term 1 LEADER]: Becoming Leader. State: Replica: b202f096955746b99d3625794b6d5210, State: Running, Role: LEADER
I20260806 18:43:49.240895 11576 consensus_queue.cc:237] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260806 18:43:49.241647 11566 sys_catalog.cc:564] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:49.242419 11578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b202f096955746b99d3625794b6d5210. Latest consensus state: current_term: 1 leader_uuid: "b202f096955746b99d3625794b6d5210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } } }
I20260806 18:43:49.242599 11578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:49.242879 11577 sys_catalog.cc:455] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b202f096955746b99d3625794b6d5210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b202f096955746b99d3625794b6d5210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } } }
I20260806 18:43:49.242980 11577 sys_catalog.cc:458] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:49.243705 11573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:49.226107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59139 (local address 127.0.0.1:34823)
0806 18:43:49.226658 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:49.226675 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:49.226718 (+ 43us) server_negotiation.cc:407] Connection header received
0806 18:43:49.227523 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:49.227581 (+ 58us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:49.228202 (+ 621us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:49.228638 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:49.229943 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:49.231006 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:49.232000 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:49.232517 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:49.232706 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:49.235922 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:49.235928 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:49.235946 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:49.236020 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:49.238813 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:49.239636 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:49.239645 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:49.239653 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:49.239828 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:49.240354 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:49.240362 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:49.240366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:49.241130 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:49.241441 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:49.241834 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 18:43:49.242121 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":173,"threads_started":1}
W20260806 18:43:49.247378 11603 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:43:49.247493 11603 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:43:49.247526 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:49.247556 11592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:49.249280 11592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:49.257948 11592 catalog_manager.cc:1347] Generated new cluster ID: fba888c14589449cb0ffca2830635239
I20260806 18:43:49.258085 11592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:49.264743 11573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:49.251326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53955 (local address 127.0.0.1:34823)
0806 18:43:49.251471 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:49.251477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:49.251894 (+ 417us) server_negotiation.cc:407] Connection header received
0806 18:43:49.252116 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:49.252119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:49.252172 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:49.252232 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:49.253110 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:49.253806 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:49.254705 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:49.254980 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:49.255098 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:49.256965 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:49.256968 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:49.256970 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:49.256999 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:49.262387 (+ 5388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:49.263134 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:49.263139 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:49.263141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:49.263250 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:49.263624 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:49.263627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:49.263629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:49.263882 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:49.264047 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:49.264444 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 18:43:49.264563 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:43:49.272073 11592 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:49.273195 11592 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:49.279155 11592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b202f096955746b99d3625794b6d5210: Generated new TSK 0
I20260806 18:43:49.280055 11592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:49.286430 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 11452
W20260806 18:43:49.307061 11431 connection.cc:535] client connection to 127.0.0.1:34823 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34823): Connection reset by peer (error 104)
2026-08-06T18:43:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1778 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:49 dist-test-slave-j2vl krb5kdc[11618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:49 dist-test-slave-j2vl krb5kdc[11618](info): set up 2 sockets
Aug 06 18:43:49 dist-test-slave-j2vl krb5kdc[11618](info): commencing operation
krb5kdc: starting...
W20260806 18:43:50.619247 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:50 dist-test-slave-j2vl krb5kdc[11618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:50.786207 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35945
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:50.923923 11636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:50.924345 11636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:50.924436 11636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:50.929412 11636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:50.929579 11636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:50.929623 11636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:50.929667 11636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:50.929702 11636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:50.936738 11636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35945
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:50.938794 11636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:50.940706 11636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:50.952229 11644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:50.952241 11648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:50.952297 11636 server_base.cc:1034] running on GCE node
W20260806 18:43:50.952229 11646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:50.953529 11636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:50.955531 11636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:50.956781 11636 hybrid_clock.cc:648] HybridClock initialized: now 1786041830956734 us; error 68 us; skew 500 ppm
Aug 06 18:43:50 dist-test-slave-j2vl krb5kdc[11618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041830, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:50.965713 11636 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:50.966981 11636 webserver.cc:460] Webserver started at http://127.0.0.1:34945/ using document root <none> and password file <none>
I20260806 18:43:50.967703 11636 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:50.967818 11636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:50.968170 11636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:50.971014 11636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "2c15d4a5762b4cd481934a4aff1283ae"
format_stamp: "Formatted at 2026-08-06 18:43:50 on dist-test-slave-j2vl"
server_key: "3cdf758272126ba688c26b0146128079"
server_key_iv: "eb83910d9f111d95eeebfa0f7130a2b8"
server_key_version: "encryptionkey@0"
I20260806 18:43:50.971757 11636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "2c15d4a5762b4cd481934a4aff1283ae"
format_stamp: "Formatted at 2026-08-06 18:43:50 on dist-test-slave-j2vl"
server_key: "3cdf758272126ba688c26b0146128079"
server_key_iv: "eb83910d9f111d95eeebfa0f7130a2b8"
server_key_version: "encryptionkey@0"
I20260806 18:43:50.976696 11636 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 18:43:50.980203 11661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:50.982096 11636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:50.982314 11636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "2c15d4a5762b4cd481934a4aff1283ae"
format_stamp: "Formatted at 2026-08-06 18:43:50 on dist-test-slave-j2vl"
server_key: "3cdf758272126ba688c26b0146128079"
server_key_iv: "eb83910d9f111d95eeebfa0f7130a2b8"
server_key_version: "encryptionkey@0"
I20260806 18:43:50.982476 11636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:51.005650 11636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:51.010159 11636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:51.010454 11636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:51.021629 11636 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35945
I20260806 18:43:51.021641 11736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35945 every 8 connection(s)
I20260806 18:43:51.022832 11636 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:51.026386 11740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:51.027266 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 11636
I20260806 18:43:51.027424 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:51.027765 12998 external_mini_cluster.cc:1428] Setting key 16f55fa85838418ca2e8412b6c38aa53
I20260806 18:43:51.033895 11740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae: Bootstrap starting.
I20260806 18:43:51.037110 11740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:51.038100 11740 log.cc:824] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:51.038398 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:51.029472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51465 (local address 127.0.0.1:35945)
0806 18:43:51.029967 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:51.029986 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:51.030027 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:43:51.030712 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:51.030730 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:51.031117 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:51.031449 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:51.031948 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:51.033013 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:51.034419 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:51.034984 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:51.035139 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:51.036243 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:51.036249 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:51.036264 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:51.036730 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:51.036796 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:51.036823 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:51.036936 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:51.037259 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 18:43:51.037471 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":160,"threads_started":1}
I20260806 18:43:51.040640 11740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae: No bootstrap required, opened a new log
I20260806 18:43:51.041988 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:51.046128 11740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } }
I20260806 18:43:51.046489 11740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:51.046567 11740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c15d4a5762b4cd481934a4aff1283ae, State: Initialized, Role: FOLLOWER
I20260806 18:43:51.047081 11740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } }
I20260806 18:43:51.047255 11740 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:51.047334 11740 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:51.047443 11740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:51.048679 11740 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } }
I20260806 18:43:51.049106 11740 leader_election.cc:302] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c15d4a5762b4cd481934a4aff1283ae; no voters:
I20260806 18:43:51.049574 11740 leader_election.cc:288] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:51.049685 11756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:51.049749 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:51.044749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53739 (local address 127.0.0.1:35945)
0806 18:43:51.044912 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:51.044993 (+ 81us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:51.045083 (+ 90us) server_negotiation.cc:407] Connection header received
0806 18:43:51.045202 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:51.045206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:51.045290 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:51.045425 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:51.045675 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:51.046459 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:51.047616 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:51.047885 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:51.048105 (+ 220us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:51.049107 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:51.049110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:51.049112 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:51.049126 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:51.049154 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:51.049166 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:51.049288 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:51.049476 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 18:43:51.049537 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:43:51.050127 11756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [term 1 LEADER]: Becoming Leader. State: Replica: 2c15d4a5762b4cd481934a4aff1283ae, State: Running, Role: LEADER
I20260806 18:43:51.050539 11756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } }
I20260806 18:43:51.051247 11740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:51.052536 11759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c15d4a5762b4cd481934a4aff1283ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } } }
I20260806 18:43:51.052714 11759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:51.052536 11761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c15d4a5762b4cd481934a4aff1283ae. Latest consensus state: current_term: 1 leader_uuid: "2c15d4a5762b4cd481934a4aff1283ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c15d4a5762b4cd481934a4aff1283ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35945 } } }
I20260806 18:43:51.053145 11761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:51.053165 11780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:51.056656 11780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:51.064270 11780 catalog_manager.cc:1347] Generated new cluster ID: 168b206a4418445bb565e93a2288d880
I20260806 18:43:51.064394 11780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:51.093676 11780 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:51.095177 11780 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:51.116307 11780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c15d4a5762b4cd481934a4aff1283ae: Generated new TSK 0
I20260806 18:43:51.117233 11780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:51.127480 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 11636
W20260806 18:43:51.152161 11616 connection.cc:535] client connection to 127.0.0.1:35945 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35945): Connection reset by peer (error 104)
2026-08-06T18:43:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1846 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:51 dist-test-slave-j2vl krb5kdc[11802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:51 dist-test-slave-j2vl krb5kdc[11802](info): set up 2 sockets
Aug 06 18:43:51 dist-test-slave-j2vl krb5kdc[11802](info): commencing operation
krb5kdc: starting...
W20260806 18:43:52.425294 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:52 dist-test-slave-j2vl krb5kdc[11802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:52.582233 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:52.713721 11818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:52.714082 11818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:52.714180 11818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:52.718655 11818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:52.718760 11818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:52.718798 11818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:52.718854 11818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:52.718894 11818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:52.724694 11818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:52.726096 11818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:52.727210 11818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:52.737365 11831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:52.737429 11818 server_base.cc:1034] running on GCE node
W20260806 18:43:52.737449 11827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:52.737512 11825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:52.738483 11818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:52.739866 11818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:52.741128 11818 hybrid_clock.cc:648] HybridClock initialized: now 1786041832741065 us; error 77 us; skew 500 ppm
Aug 06 18:43:52 dist-test-slave-j2vl krb5kdc[11802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041832, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:52.744417 11818 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:52.745611 11818 webserver.cc:460] Webserver started at http://127.0.0.1:33029/ using document root <none> and password file <none>
I20260806 18:43:52.746227 11818 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:52.746295 11818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:52.746502 11818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:52.748771 11818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "23764a932a1e45be8f3553c5c72f3fb5"
format_stamp: "Formatted at 2026-08-06 18:43:52 on dist-test-slave-j2vl"
server_key: "9fa88dcd64bf280de38c40909bf8b424"
server_key_iv: "29fcf58e8fc104546aad1b9f62f57014"
server_key_version: "encryptionkey@0"
I20260806 18:43:52.749476 11818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "23764a932a1e45be8f3553c5c72f3fb5"
format_stamp: "Formatted at 2026-08-06 18:43:52 on dist-test-slave-j2vl"
server_key: "9fa88dcd64bf280de38c40909bf8b424"
server_key_iv: "29fcf58e8fc104546aad1b9f62f57014"
server_key_version: "encryptionkey@0"
I20260806 18:43:52.753870 11818 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:43:52.756683 11840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:52.758184 11818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:52.758358 11818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "23764a932a1e45be8f3553c5c72f3fb5"
format_stamp: "Formatted at 2026-08-06 18:43:52 on dist-test-slave-j2vl"
server_key: "9fa88dcd64bf280de38c40909bf8b424"
server_key_iv: "29fcf58e8fc104546aad1b9f62f57014"
server_key_version: "encryptionkey@0"
I20260806 18:43:52.758473 11818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:52.763705 11818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:52.768000 11818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:52.768196 11818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:52.776705 11818 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38765
I20260806 18:43:52.776723 11935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38765 every 8 connection(s)
I20260806 18:43:52.777936 11818 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:52.781100 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:52.781400 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 11818
I20260806 18:43:52.781574 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:52.781913 12998 external_mini_cluster.cc:1428] Setting key b582a7e74e950227c9a66abab1d29e0e
I20260806 18:43:52.788223 11941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:52.783604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53419 (local address 127.0.0.1:38765)
0806 18:43:52.784110 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:52.784131 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:52.784182 (+ 51us) server_negotiation.cc:407] Connection header received
0806 18:43:52.784992 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:52.785018 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:52.785469 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:52.785874 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:52.786719 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:52.786725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:52.786741 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:52.786755 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:52.786822 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:52.786849 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:52.787004 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:52.787081 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 18:43:52.787259 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":151,"threads_started":1}
I20260806 18:43:52.789202 11937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5: Bootstrap starting.
I20260806 18:43:52.791712 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:52.792129 11937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:52.792941 11937 log.cc:824] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:52.795573 11937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5: No bootstrap required, opened a new log
I20260806 18:43:52.796012 11941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:52.794103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51521 (local address 127.0.0.1:38765)
0806 18:43:52.794250 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:52.794255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:52.794460 (+ 205us) server_negotiation.cc:407] Connection header received
0806 18:43:52.794599 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:52.794601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:52.794636 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:52.794697 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:52.795505 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:52.795508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:52.795510 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:52.795522 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:52.795551 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:52.795562 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:52.795643 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:52.795792 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 18:43:52.795833 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:43:52.799795 11937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } }
I20260806 18:43:52.800083 11937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:52.800120 11937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23764a932a1e45be8f3553c5c72f3fb5, State: Initialized, Role: FOLLOWER
I20260806 18:43:52.800798 11937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } }
I20260806 18:43:52.801011 11937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:52.801116 11937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:52.801246 11937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:52.802637 11937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } }
I20260806 18:43:52.803077 11937 leader_election.cc:302] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23764a932a1e45be8f3553c5c72f3fb5; no voters:
I20260806 18:43:52.803465 11937 leader_election.cc:288] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:52.803642 11953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:52.803948 11953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 23764a932a1e45be8f3553c5c72f3fb5, State: Running, Role: LEADER
I20260806 18:43:52.804297 11953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } }
I20260806 18:43:52.804919 11937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:52.806283 11956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23764a932a1e45be8f3553c5c72f3fb5. Latest consensus state: current_term: 1 leader_uuid: "23764a932a1e45be8f3553c5c72f3fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } } }
I20260806 18:43:52.806453 11956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:52.806802 11955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23764a932a1e45be8f3553c5c72f3fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23764a932a1e45be8f3553c5c72f3fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38765 } } }
I20260806 18:43:52.806875 11970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:52.806989 11955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:52.810708 11970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:52.817642 11970 catalog_manager.cc:1347] Generated new cluster ID: d8c9389bfe4840bf8f3056b95f28465b
I20260806 18:43:52.817747 11970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:52.834254 11970 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:52.834702 11970 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:52.842285 11970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23764a932a1e45be8f3553c5c72f3fb5: Generated new TSK 0
I20260806 18:43:52.843185 11970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:52.854663 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 11818
2026-08-06T18:43:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1715 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:52 dist-test-slave-j2vl krb5kdc[11994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:52 dist-test-slave-j2vl krb5kdc[11994](info): set up 2 sockets
Aug 06 18:43:52 dist-test-slave-j2vl krb5kdc[11994](info): commencing operation
krb5kdc: starting...
W20260806 18:43:54.145812 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[11994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:54.309784 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:54.437489 12019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:54.437842 12019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:54.438068 12019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:54.442555 12019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:54.442652 12019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:54.442677 12019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:54.442694 12019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:54.442710 12019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:54.449234 12019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:54.450843 12019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:54.452082 12019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:54.465298 12028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:54.465327 12030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:54.465727 12027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:54.466663 12019 server_base.cc:1034] running on GCE node
I20260806 18:43:54.468384 12019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:54.470624 12019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:54.472067 12019 hybrid_clock.cc:648] HybridClock initialized: now 1786041834472026 us; error 69 us; skew 500 ppm
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[11994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041834, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:54.476656 12019 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:54.478026 12019 webserver.cc:460] Webserver started at http://127.0.0.1:34013/ using document root <none> and password file <none>
I20260806 18:43:54.478760 12019 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:54.478840 12019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:54.479103 12019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:54.482471 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "205bec006d4141ac91cfe3c948f90a0b"
format_stamp: "Formatted at 2026-08-06 18:43:54 on dist-test-slave-j2vl"
server_key: "f2b3e38850f700ab027591666b75ef26"
server_key_iv: "11e21c14e3ec647148e535183dabc590"
server_key_version: "encryptionkey@0"
I20260806 18:43:54.483260 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "205bec006d4141ac91cfe3c948f90a0b"
format_stamp: "Formatted at 2026-08-06 18:43:54 on dist-test-slave-j2vl"
server_key: "f2b3e38850f700ab027591666b75ef26"
server_key_iv: "11e21c14e3ec647148e535183dabc590"
server_key_version: "encryptionkey@0"
I20260806 18:43:54.488224 12019 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:43:54.491685 12042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:54.493589 12019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:54.493753 12019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "205bec006d4141ac91cfe3c948f90a0b"
format_stamp: "Formatted at 2026-08-06 18:43:54 on dist-test-slave-j2vl"
server_key: "f2b3e38850f700ab027591666b75ef26"
server_key_iv: "11e21c14e3ec647148e535183dabc590"
server_key_version: "encryptionkey@0"
I20260806 18:43:54.493898 12019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:54.521871 12019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:54.525614 12019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:54.525871 12019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:54.535240 12019 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39845
I20260806 18:43:54.535300 12124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39845 every 8 connection(s)
I20260806 18:43:54.536496 12019 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:54.539973 12125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:54.540848 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12019
I20260806 18:43:54.541075 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:54.541529 12998 external_mini_cluster.cc:1428] Setting key d899c9a27add2a81285fbb4c415fc50c
I20260806 18:43:54.547325 12125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: Bootstrap starting.
I20260806 18:43:54.550376 12125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:54.551380 12125 log.cc:824] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[11994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 18:43:54.554237 12125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: No bootstrap required, opened a new log
I20260806 18:43:54.558440 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:54.543271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35725 (local address 127.0.0.1:39845)
0806 18:43:54.543843 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:54.543860 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:54.543912 (+ 52us) server_negotiation.cc:407] Connection header received
0806 18:43:54.544654 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:54.544675 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:54.545075 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:54.545552 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:54.546435 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:54.547567 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:54.548532 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:54.549067 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:54.549260 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:54.552572 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:54.552579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:54.552596 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:54.552627 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:54.554766 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:54.555396 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:54.555402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:54.555408 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:54.555539 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:54.555910 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:54.555914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:54.555915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:54.556403 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:54.556596 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:54.557086 (+ 490us) server_negotiation.cc:299] Negotiation successful
0806 18:43:54.557556 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":188,"threads_started":1}
I20260806 18:43:54.559023 12125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260806 18:43:54.559300 12125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:54.559363 12125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 205bec006d4141ac91cfe3c948f90a0b, State: Initialized, Role: FOLLOWER
I20260806 18:43:54.559944 12125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260806 18:43:54.560125 12125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:54.560189 12125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:54.560299 12125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:54.561730 12125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260806 18:43:54.562268 12125 leader_election.cc:302] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 205bec006d4141ac91cfe3c948f90a0b; no voters:
I20260806 18:43:54.562693 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:54.562711 12125 leader_election.cc:288] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:54.562858 12137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:54.563139 12137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [term 1 LEADER]: Becoming Leader. State: Replica: 205bec006d4141ac91cfe3c948f90a0b, State: Running, Role: LEADER
I20260806 18:43:54.563498 12137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260806 18:43:54.564332 12125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:54.565451 12140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 205bec006d4141ac91cfe3c948f90a0b. Latest consensus state: current_term: 1 leader_uuid: "205bec006d4141ac91cfe3c948f90a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } } }
I20260806 18:43:54.565619 12140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:54.565944 12139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "205bec006d4141ac91cfe3c948f90a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205bec006d4141ac91cfe3c948f90a0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } } }
I20260806 18:43:54.566061 12139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b [sys.catalog]: This master's current role is: LEADER
W20260806 18:43:54.570374 12171 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:43:54.570487 12171 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:43:54.570565 12158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:54.571579 12158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:54.574874 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:54.565527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34683 (local address 127.0.0.1:39845)
0806 18:43:54.565647 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:54.565651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:54.565670 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:43:54.565740 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:54.565743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:54.565795 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:54.565895 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:54.566868 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:54.567711 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:54.568919 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:54.569277 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:54.569427 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:54.571129 (+ 1702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:54.571133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:54.571135 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:54.571172 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:54.572781 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:54.573291 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:54.573294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:54.573296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:54.573453 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:54.573783 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:54.573786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:54.573788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:54.574072 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:54.574206 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:54.574549 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 18:43:54.574693 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":48}
I20260806 18:43:54.578526 12158 catalog_manager.cc:1347] Generated new cluster ID: 3e053a169a0b4230983333b1878a6398
I20260806 18:43:54.578627 12158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:54.637305 12158 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:54.638473 12158 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:54.650820 12158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 205bec006d4141ac91cfe3c948f90a0b: Generated new TSK 0
I20260806 18:43:54.651728 12158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:54.662014 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12019
2026-08-06T18:43:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1812 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[12185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[12185](info): set up 2 sockets
Aug 06 18:43:54 dist-test-slave-j2vl krb5kdc[12185](info): commencing operation
krb5kdc: starting...
W20260806 18:43:55.953112 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:56 dist-test-slave-j2vl krb5kdc[12185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:56.102557 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41735
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41735
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:56.232342 12207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:56.232827 12207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:56.232932 12207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:56.237779 12207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:56.237919 12207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:56.237962 12207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:56.238004 12207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:56.238040 12207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:56.244191 12207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:56.245679 12207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:56.246876 12207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:56.256737 12214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:56.256819 12218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:56.256876 12215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:56.257005 12207 server_base.cc:1034] running on GCE node
I20260806 18:43:56.257853 12207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:56.259173 12207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:56.260409 12207 hybrid_clock.cc:648] HybridClock initialized: now 1786041836260373 us; error 53 us; skew 500 ppm
Aug 06 18:43:56 dist-test-slave-j2vl krb5kdc[12185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041836, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:56.270097 12207 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:56.271329 12207 webserver.cc:460] Webserver started at http://127.0.0.1:38477/ using document root <none> and password file <none>
I20260806 18:43:56.272085 12207 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:56.272188 12207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:56.272447 12207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:56.275256 12207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "d53fd064f6b84af68a5f3ed6dd551870"
format_stamp: "Formatted at 2026-08-06 18:43:56 on dist-test-slave-j2vl"
server_key: "35bb400c9177095a47643ec1cf5904bc"
server_key_iv: "81a9fefa0663b6d7239a1feca97787a5"
server_key_version: "encryptionkey@0"
I20260806 18:43:56.275942 12207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "d53fd064f6b84af68a5f3ed6dd551870"
format_stamp: "Formatted at 2026-08-06 18:43:56 on dist-test-slave-j2vl"
server_key: "35bb400c9177095a47643ec1cf5904bc"
server_key_iv: "81a9fefa0663b6d7239a1feca97787a5"
server_key_version: "encryptionkey@0"
I20260806 18:43:56.281064 12207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 18:43:56.284205 12240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:56.285854 12207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:56.286033 12207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "d53fd064f6b84af68a5f3ed6dd551870"
format_stamp: "Formatted at 2026-08-06 18:43:56 on dist-test-slave-j2vl"
server_key: "35bb400c9177095a47643ec1cf5904bc"
server_key_iv: "81a9fefa0663b6d7239a1feca97787a5"
server_key_version: "encryptionkey@0"
I20260806 18:43:56.286175 12207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:56.299669 12207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:56.303067 12207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:56.303419 12207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:56.311586 12207 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41735
I20260806 18:43:56.311614 12318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41735 every 8 connection(s)
I20260806 18:43:56.312659 12207 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:56.316608 12319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:56.322746 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12207
I20260806 18:43:56.323035 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:56.323405 12998 external_mini_cluster.cc:1428] Setting key 1f916a26bb5d23706d4e14ebe5732e96
I20260806 18:43:56.325106 12319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: Bootstrap starting.
I20260806 18:43:56.328655 12319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:56.330533 12319 log.cc:824] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:56.333683 12319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: No bootstrap required, opened a new log
I20260806 18:43:56.335902 12323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:56.325065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52301 (local address 127.0.0.1:41735)
0806 18:43:56.326760 (+ 1695us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:56.326782 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:56.326845 (+ 63us) server_negotiation.cc:407] Connection header received
0806 18:43:56.327984 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:56.328008 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:56.328508 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:56.328897 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:56.329260 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:56.330982 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:56.332052 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:56.332592 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:56.332775 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:56.333745 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:56.333754 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:56.333777 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:56.334454 (+ 677us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:56.334526 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:56.334551 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:56.334670 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:56.334819 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 18:43:56.335068 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1506,"thread_start_us":1157,"threads_started":1}
I20260806 18:43:56.340050 12319 raft_consensus.cc:348] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } }
I20260806 18:43:56.340508 12319 raft_consensus.cc:374] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:56.340582 12319 raft_consensus.cc:729] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d53fd064f6b84af68a5f3ed6dd551870, State: Initialized, Role: FOLLOWER
I20260806 18:43:56.341208 12319 consensus_queue.cc:260] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } }
I20260806 18:43:56.341423 12319 raft_consensus.cc:388] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:56.341506 12319 raft_consensus.cc:482] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:56.341619 12319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:56.342425 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:56.343055 12319 raft_consensus.cc:504] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } }
I20260806 18:43:56.343513 12319 leader_election.cc:302] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d53fd064f6b84af68a5f3ed6dd551870; no voters:
I20260806 18:43:56.343920 12319 leader_election.cc:288] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:56.344030 12328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:56.344288 12328 raft_consensus.cc:686] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [term 1 LEADER]: Becoming Leader. State: Replica: d53fd064f6b84af68a5f3ed6dd551870, State: Running, Role: LEADER
I20260806 18:43:56.344635 12328 consensus_queue.cc:237] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } }
I20260806 18:43:56.345554 12319 sys_catalog.cc:564] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:56.346110 12339 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d53fd064f6b84af68a5f3ed6dd551870. Latest consensus state: current_term: 1 leader_uuid: "d53fd064f6b84af68a5f3ed6dd551870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } } }
I20260806 18:43:56.346264 12339 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:56.346586 12337 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d53fd064f6b84af68a5f3ed6dd551870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fd064f6b84af68a5f3ed6dd551870" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41735 } } }
I20260806 18:43:56.346688 12337 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:56.350908 12323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:56.345239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44623 (local address 127.0.0.1:41735)
0806 18:43:56.345390 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:56.345395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:56.345701 (+ 306us) server_negotiation.cc:407] Connection header received
0806 18:43:56.345792 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:56.345795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:56.345854 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:56.345955 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:56.346514 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:56.347361 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:56.348873 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:56.349203 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:56.349285 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:56.350409 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:56.350415 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:56.350419 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:56.350436 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:56.350464 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:56.350476 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:56.350521 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:56.350702 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 18:43:56.350778 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 18:43:56.352013 12360 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:43:56.352118 12360 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:43:56.352181 12346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:56.353376 12346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:56.361119 12346 catalog_manager.cc:1347] Generated new cluster ID: 4f465780faeb470faeb9e554c76bf32f
I20260806 18:43:56.361205 12346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:56.389470 12346 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:56.390923 12346 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:56.399657 12346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d53fd064f6b84af68a5f3ed6dd551870: Generated new TSK 0
I20260806 18:43:56.401178 12346 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:56.418140 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12207
2026-08-06T18:43:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1745 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:56 dist-test-slave-j2vl krb5kdc[12366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:56 dist-test-slave-j2vl krb5kdc[12366](info): set up 2 sockets
Aug 06 18:43:56 dist-test-slave-j2vl krb5kdc[12366](info): commencing operation
krb5kdc: starting...
W20260806 18:43:57.690778 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:57 dist-test-slave-j2vl krb5kdc[12366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:57.842159 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34445
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:57.969229 12382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:57.969882 12382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:57.970008 12382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:57.974325 12382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:57.974452 12382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:57.974489 12382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:57.974531 12382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:57.974587 12382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:57.981088 12382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:57.982447 12382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:57.983620 12382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:57.994197 12391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:57.994238 12401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:57.994652 12382 server_base.cc:1034] running on GCE node
W20260806 18:43:57.994197 12389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:57.995466 12382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:57.996817 12382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:57.998005 12382 hybrid_clock.cc:648] HybridClock initialized: now 1786041837997974 us; error 49 us; skew 500 ppm
Aug 06 18:43:57 dist-test-slave-j2vl krb5kdc[12366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041837, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:58.001452 12382 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:58.002622 12382 webserver.cc:460] Webserver started at http://127.0.0.1:41673/ using document root <none> and password file <none>
I20260806 18:43:58.003309 12382 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:58.003384 12382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:58.003685 12382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:58.006191 12382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f"
format_stamp: "Formatted at 2026-08-06 18:43:57 on dist-test-slave-j2vl"
server_key: "785b167e9dc91c47d7f759fa6d0683e2"
server_key_iv: "553db113e3302031e5e6f29539d1f9aa"
server_key_version: "encryptionkey@0"
I20260806 18:43:58.007103 12382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f"
format_stamp: "Formatted at 2026-08-06 18:43:57 on dist-test-slave-j2vl"
server_key: "785b167e9dc91c47d7f759fa6d0683e2"
server_key_iv: "553db113e3302031e5e6f29539d1f9aa"
server_key_version: "encryptionkey@0"
I20260806 18:43:58.011746 12382 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:58.014633 12409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:58.016088 12382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:43:58.016269 12382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f"
format_stamp: "Formatted at 2026-08-06 18:43:57 on dist-test-slave-j2vl"
server_key: "785b167e9dc91c47d7f759fa6d0683e2"
server_key_iv: "553db113e3302031e5e6f29539d1f9aa"
server_key_version: "encryptionkey@0"
I20260806 18:43:58.016405 12382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:58.021661 12382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:58.025143 12382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:58.025408 12382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:58.033432 12382 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34445
I20260806 18:43:58.033454 12501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34445 every 8 connection(s)
I20260806 18:43:58.034641 12382 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:58.037778 12502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:58.041566 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12382
I20260806 18:43:58.041734 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:58.042025 12998 external_mini_cluster.cc:1428] Setting key 52713c54b7e3366dfddd73d0472ca9c8
I20260806 18:43:58.045111 12502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f: Bootstrap starting.
I20260806 18:43:58.047998 12505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:58.043612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50147 (local address 127.0.0.1:34445)
0806 18:43:58.044135 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:58.044152 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:58.044191 (+ 39us) server_negotiation.cc:407] Connection header received
0806 18:43:58.044898 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:58.044918 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:58.045230 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:58.045639 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:58.046596 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:58.046601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:58.046614 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:58.046626 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:58.046688 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:58.046709 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:58.046852 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:58.046953 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 18:43:58.047150 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":207,"threads_started":1}
I20260806 18:43:58.048146 12502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:58.049182 12502 log.cc:824] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:58.051532 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:58.051867 12502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f: No bootstrap required, opened a new log
I20260806 18:43:58.056751 12505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:58.053969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39321 (local address 127.0.0.1:34445)
0806 18:43:58.054120 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:58.054125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:58.054401 (+ 276us) server_negotiation.cc:407] Connection header received
0806 18:43:58.054490 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:58.054492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:58.054531 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:58.054604 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:58.056180 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:58.056183 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:58.056186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:43:58.056203 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:58.056246 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:43:58.056259 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:58.056350 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:58.056503 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 18:43:58.056556 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:43:58.056934 12502 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260806 18:43:58.057301 12502 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:58.057464 12502 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6fe9390bf4b48709dacd6b8e2b2dd4f, State: Initialized, Role: FOLLOWER
I20260806 18:43:58.058055 12502 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260806 18:43:58.058274 12502 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:58.058362 12502 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:58.058477 12502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:58.060336 12502 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260806 18:43:58.060935 12502 leader_election.cc:302] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6fe9390bf4b48709dacd6b8e2b2dd4f; no voters:
I20260806 18:43:58.061488 12502 leader_election.cc:288] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:58.061620 12515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:58.061884 12515 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [term 1 LEADER]: Becoming Leader. State: Replica: f6fe9390bf4b48709dacd6b8e2b2dd4f, State: Running, Role: LEADER
I20260806 18:43:58.062268 12515 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260806 18:43:58.063126 12502 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:58.064343 12518 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6fe9390bf4b48709dacd6b8e2b2dd4f. Latest consensus state: current_term: 1 leader_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } } }
I20260806 18:43:58.064410 12516 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6fe9390bf4b48709dacd6b8e2b2dd4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } } }
I20260806 18:43:58.064496 12518 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:58.064527 12516 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:58.065639 12530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:58.068930 12530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:58.075258 12530 catalog_manager.cc:1347] Generated new cluster ID: 8b567002710c44b6a3ea1e0bce04a980
I20260806 18:43:58.075374 12530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:58.097774 12530 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:58.098203 12530 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:58.103235 12530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6fe9390bf4b48709dacd6b8e2b2dd4f: Generated new TSK 0
I20260806 18:43:58.104261 12530 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:58.116693 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12382
2026-08-06T18:43:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1708 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:58 dist-test-slave-j2vl krb5kdc[12546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:58 dist-test-slave-j2vl krb5kdc[12546](info): set up 2 sockets
Aug 06 18:43:58 dist-test-slave-j2vl krb5kdc[12546](info): commencing operation
krb5kdc: starting...
W20260806 18:43:59.403852 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:43:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:43:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:43:59.557729 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:43:59.686367 12565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:43:59.686756 12565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:43:59.686848 12565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:43:59.691516 12565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:43:59.691682 12565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:43:59.691722 12565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:43:59.691763 12565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:43:59.691800 12565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:43:59.698215 12565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:43:59.699594 12565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:43:59.700798 12565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:43:59.711041 12578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:59.711128 12577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:43:59.711041 12584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:43:59.711438 12565 server_base.cc:1034] running on GCE node
I20260806 18:43:59.712216 12565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:43:59.713586 12565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:43:59.714802 12565 hybrid_clock.cc:648] HybridClock initialized: now 1786041839714786 us; error 33 us; skew 500 ppm
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041839, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:43:59.718058 12565 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:43:59.719260 12565 webserver.cc:460] Webserver started at http://127.0.0.1:35103/ using document root <none> and password file <none>
I20260806 18:43:59.719911 12565 fs_manager.cc:359] Metadata directory not provided
I20260806 18:43:59.720019 12565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:43:59.720284 12565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:43:59.722681 12565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "4c33dea3dafa4c6f9867608520313621"
format_stamp: "Formatted at 2026-08-06 18:43:59 on dist-test-slave-j2vl"
server_key: "4ca5da94a41afe3c3385cffa19433e0c"
server_key_iv: "5094d490cac1313ec76861e1d48c80f3"
server_key_version: "encryptionkey@0"
I20260806 18:43:59.723346 12565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "4c33dea3dafa4c6f9867608520313621"
format_stamp: "Formatted at 2026-08-06 18:43:59 on dist-test-slave-j2vl"
server_key: "4ca5da94a41afe3c3385cffa19433e0c"
server_key_iv: "5094d490cac1313ec76861e1d48c80f3"
server_key_version: "encryptionkey@0"
I20260806 18:43:59.727898 12565 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:43:59.730958 12592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:43:59.732563 12565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:43:59.732882 12565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "4c33dea3dafa4c6f9867608520313621"
format_stamp: "Formatted at 2026-08-06 18:43:59 on dist-test-slave-j2vl"
server_key: "4ca5da94a41afe3c3385cffa19433e0c"
server_key_iv: "5094d490cac1313ec76861e1d48c80f3"
server_key_version: "encryptionkey@0"
I20260806 18:43:59.733045 12565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:43:59.753922 12565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:43:59.757472 12565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:43:59.757699 12565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:43:59.766207 12565 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42117
I20260806 18:43:59.766214 12661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42117 every 8 connection(s)
I20260806 18:43:59.767359 12565 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:43:59.770628 12664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:43:59.776791 12664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621: Bootstrap starting.
I20260806 18:43:59.777208 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12565
I20260806 18:43:59.777432 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:43:59.777714 12998 external_mini_cluster.cc:1428] Setting key 668ff0be8e30d41619afe5d033691426
I20260806 18:43:59.780040 12664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621: Neither blocks nor log segments found. Creating new log.
I20260806 18:43:59.780891 12664 log.cc:824] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621: Log is configured to *not* fsync() on all Append() calls
I20260806 18:43:59.783370 12664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621: No bootstrap required, opened a new log
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 18:43:59.787775 12664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260806 18:43:59.788091 12664 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:43:59.788195 12664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c33dea3dafa4c6f9867608520313621, State: Initialized, Role: FOLLOWER
I20260806 18:43:59.788730 12664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260806 18:43:59.788923 12664 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:43:59.789011 12664 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:43:59.789136 12664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:43:59.790647 12664 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260806 18:43:59.791070 12664 leader_election.cc:302] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c33dea3dafa4c6f9867608520313621; no voters:
I20260806 18:43:59.791484 12664 leader_election.cc:288] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:43:59.791749 12674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:43:59.792030 12674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [term 1 LEADER]: Becoming Leader. State: Replica: 4c33dea3dafa4c6f9867608520313621, State: Running, Role: LEADER
I20260806 18:43:59.792419 12674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260806 18:43:59.793064 12664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:43:59.794334 12675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c33dea3dafa4c6f9867608520313621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } } }
I20260806 18:43:59.794476 12675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:59.795053 12676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c33dea3dafa4c6f9867608520313621. Latest consensus state: current_term: 1 leader_uuid: "4c33dea3dafa4c6f9867608520313621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c33dea3dafa4c6f9867608520313621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } } }
I20260806 18:43:59.795147 12676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621 [sys.catalog]: This master's current role is: LEADER
I20260806 18:43:59.795888 12690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:43:59.795962 12672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:59.779271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:50531 (local address 127.0.0.1:42117)
0806 18:43:59.779804 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:59.779820 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:59.779864 (+ 44us) server_negotiation.cc:407] Connection header received
0806 18:43:59.780664 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:59.780684 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:59.781117 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:59.781540 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:59.782512 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:59.783976 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:59.784906 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:59.785705 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:59.785890 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:59.788737 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:59.788748 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:59.788768 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:59.788807 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:59.791259 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:59.792167 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:59.792174 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:59.792181 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:59.792338 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:59.792802 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:59.792805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:59.792807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:59.793385 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:59.793618 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:59.794403 (+ 785us) server_negotiation.cc:299] Negotiation successful
0806 18:43:59.794841 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":161,"threads_started":1}
I20260806 18:43:59.799335 12690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:43:59.799938 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:43:59.807052 12690 catalog_manager.cc:1347] Generated new cluster ID: 20c3f1d9f00d4d919736e3dd73a79740
I20260806 18:43:59.807155 12690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:43:59.815528 12672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:43:59.802727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:34133 (local address 127.0.0.1:42117)
0806 18:43:59.802877 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 18:43:59.802882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:43:59.803267 (+ 385us) server_negotiation.cc:407] Connection header received
0806 18:43:59.803410 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:43:59.803413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:43:59.803471 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:43:59.803565 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:43:59.805089 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:59.806136 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:59.807476 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:43:59.807810 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:43:59.807939 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:43:59.810422 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:43:59.810426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:43:59.810429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:43:59.810494 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:43:59.812918 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:59.813944 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:59.813948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:59.813951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:59.814076 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:43:59.814472 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:43:59.814475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:43:59.814477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:43:59.814727 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:43:59.814890 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 18:43:59.815207 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 18:43:59.815353 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 18:43:59.822363 12690 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:43:59.823729 12690 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:43:59.830798 12690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c33dea3dafa4c6f9867608520313621: Generated new TSK 0
I20260806 18:43:59.831678 12690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:43:59.841015 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12565
W20260806 18:43:59.862367 12544 connection.cc:535] client connection to 127.0.0.1:42117 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42117): Connection reset by peer (error 104)
2026-08-06T18:43:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1728 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12713](info): set up 2 sockets
Aug 06 18:43:59 dist-test-slave-j2vl krb5kdc[12713](info): commencing operation
krb5kdc: starting...
W20260806 18:44:01.178712 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:01 dist-test-slave-j2vl krb5kdc[12713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:44:01.337715 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42363
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:01.469138 12732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:01.469563 12732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:01.469657 12732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:01.473834 12732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:01.473955 12732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:01.473999 12732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:01.474037 12732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:01.474077 12732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:01.479846 12732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:01.481091 12732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:01.482224 12732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:01.491664 12737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:01.491722 12732 server_base.cc:1034] running on GCE node
W20260806 18:44:01.491676 12740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:01.491695 12738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:01.492590 12732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:01.493924 12732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:01.495137 12732 hybrid_clock.cc:648] HybridClock initialized: now 1786041841495108 us; error 46 us; skew 500 ppm
Aug 06 18:44:01 dist-test-slave-j2vl krb5kdc[12713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041841, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:01.510193 12732 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:44:01.511499 12732 webserver.cc:460] Webserver started at http://127.0.0.1:44453/ using document root <none> and password file <none>
I20260806 18:44:01.512200 12732 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:01.512285 12732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:01.512498 12732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:01.515175 12732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "9f1f0f9028034d1f8e653bc97dbd7abe"
format_stamp: "Formatted at 2026-08-06 18:44:01 on dist-test-slave-j2vl"
server_key: "7d3598d650c6745d1e3ce93e473b927d"
server_key_iv: "3a6b8f7ae9c10f18a7be7db393806536"
server_key_version: "encryptionkey@0"
I20260806 18:44:01.515839 12732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "9f1f0f9028034d1f8e653bc97dbd7abe"
format_stamp: "Formatted at 2026-08-06 18:44:01 on dist-test-slave-j2vl"
server_key: "7d3598d650c6745d1e3ce93e473b927d"
server_key_iv: "3a6b8f7ae9c10f18a7be7db393806536"
server_key_version: "encryptionkey@0"
I20260806 18:44:01.520462 12732 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 18:44:01.523343 12747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:01.524713 12732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:44:01.524871 12732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "9f1f0f9028034d1f8e653bc97dbd7abe"
format_stamp: "Formatted at 2026-08-06 18:44:01 on dist-test-slave-j2vl"
server_key: "7d3598d650c6745d1e3ce93e473b927d"
server_key_iv: "3a6b8f7ae9c10f18a7be7db393806536"
server_key_version: "encryptionkey@0"
I20260806 18:44:01.524976 12732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:01.551020 12732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:01.554378 12732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:01.554554 12732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:01.562544 12732 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42363
I20260806 18:44:01.562570 12825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42363 every 8 connection(s)
I20260806 18:44:01.563668 12732 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:01.567052 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:01.567723 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12732
I20260806 18:44:01.567905 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:01.568218 12998 external_mini_cluster.cc:1428] Setting key 571fb2fc7aec5e773416c3146d11b857
I20260806 18:44:01.574860 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe: Bootstrap starting.
I20260806 18:44:01.577828 12828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:01.578812 12828 log.cc:824] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:01.579049 12832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:01.569957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:47165 (local address 127.0.0.1:42363)
0806 18:44:01.570485 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:01.570502 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:01.570542 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:01.571274 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:01.571295 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:01.571672 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:01.572155 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:01.572612 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:01.574042 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:01.575026 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:01.575554 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:01.575744 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:01.577011 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:01.577016 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:01.577033 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:01.577576 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:01.577647 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:01.577674 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:01.577834 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:01.578028 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 18:44:01.578198 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":166,"threads_started":1}
I20260806 18:44:01.582331 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe: No bootstrap required, opened a new log
I20260806 18:44:01.583868 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:01.587796 12828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260806 18:44:01.588367 12828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:01.588475 12828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f1f0f9028034d1f8e653bc97dbd7abe, State: Initialized, Role: FOLLOWER
I20260806 18:44:01.589195 12828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260806 18:44:01.589411 12828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:01.589514 12828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:01.589641 12828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:01.591403 12828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260806 18:44:01.591958 12828 leader_election.cc:302] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f1f0f9028034d1f8e653bc97dbd7abe; no voters:
I20260806 18:44:01.592432 12828 leader_election.cc:288] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:01.592521 12841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:01.592805 12841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [term 1 LEADER]: Becoming Leader. State: Replica: 9f1f0f9028034d1f8e653bc97dbd7abe, State: Running, Role: LEADER
I20260806 18:44:01.593436 12832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:01.586477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:39933 (local address 127.0.0.1:42363)
0806 18:44:01.586644 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:01.586649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:01.586669 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:44:01.586792 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:01.586795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:01.586857 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:01.586951 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:01.587355 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:01.588117 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:01.589921 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:01.590274 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:01.590410 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:01.592432 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:01.592442 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:01.592446 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:01.592467 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:01.592547 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:01.592569 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:01.592699 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:01.592892 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 18:44:01.593217 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 18:44:01.593223 12841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260806 18:44:01.594130 12828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:01.595328 12841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f1f0f9028034d1f8e653bc97dbd7abe. Latest consensus state: current_term: 1 leader_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } } }
I20260806 18:44:01.595579 12841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:01.596833 12842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f1f0f9028034d1f8e653bc97dbd7abe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } } }
I20260806 18:44:01.596987 12842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:01.597723 12853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:01.601686 12853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:01.610018 12853 catalog_manager.cc:1347] Generated new cluster ID: d137248611654172beb65c4ac6a0082a
I20260806 18:44:01.610149 12853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:01.632997 12853 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:01.634176 12853 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:01.644095 12853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f1f0f9028034d1f8e653bc97dbd7abe: Generated new TSK 0
I20260806 18:44:01.645112 12853 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:01.656644 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12732
W20260806 18:44:01.684967 12710 connection.cc:535] client connection to 127.0.0.1:42363 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42363): Connection reset by peer (error 104)
2026-08-06T18:44:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1822 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:01 dist-test-slave-j2vl krb5kdc[12879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:01 dist-test-slave-j2vl krb5kdc[12879](info): set up 2 sockets
Aug 06 18:44:01 dist-test-slave-j2vl krb5kdc[12879](info): commencing operation
krb5kdc: starting...
W20260806 18:44:02.975549 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:03 dist-test-slave-j2vl krb5kdc[12879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:44:03.134652 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37417
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:03.261439 12897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:03.261837 12897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:03.261937 12897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:03.266299 12897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:03.266433 12897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:03.266471 12897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:03.266515 12897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:03.266551 12897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:03.272454 12897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:03.273860 12897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:03.275095 12897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:03.285473 12907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:03.285473 12904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:03.285478 12912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:03.285535 12897 server_base.cc:1034] running on GCE node
I20260806 18:44:03.286582 12897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:03.288024 12897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:03.289248 12897 hybrid_clock.cc:648] HybridClock initialized: now 1786041843289235 us; error 35 us; skew 500 ppm
Aug 06 18:44:03 dist-test-slave-j2vl krb5kdc[12879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041843, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:03.292500 12897 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:44:03.293634 12897 webserver.cc:460] Webserver started at http://127.0.0.1:40451/ using document root <none> and password file <none>
I20260806 18:44:03.294210 12897 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:03.294273 12897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:03.294461 12897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:03.296674 12897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "71c588c842c845abb5ca1ffa514ea3a9"
format_stamp: "Formatted at 2026-08-06 18:44:03 on dist-test-slave-j2vl"
server_key: "a6229254918d7a515e092ea60527b470"
server_key_iv: "fc5b5d7adddd865918c14a55c73188a6"
server_key_version: "encryptionkey@0"
I20260806 18:44:03.297247 12897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "71c588c842c845abb5ca1ffa514ea3a9"
format_stamp: "Formatted at 2026-08-06 18:44:03 on dist-test-slave-j2vl"
server_key: "a6229254918d7a515e092ea60527b470"
server_key_iv: "fc5b5d7adddd865918c14a55c73188a6"
server_key_version: "encryptionkey@0"
I20260806 18:44:03.301846 12897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:44:03.304742 12926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:03.306582 12897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:03.306770 12897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "71c588c842c845abb5ca1ffa514ea3a9"
format_stamp: "Formatted at 2026-08-06 18:44:03 on dist-test-slave-j2vl"
server_key: "a6229254918d7a515e092ea60527b470"
server_key_iv: "fc5b5d7adddd865918c14a55c73188a6"
server_key_version: "encryptionkey@0"
I20260806 18:44:03.306931 12897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:03.312427 12897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:03.316208 12897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:03.316449 12897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:03.325107 12897 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37417
I20260806 18:44:03.325137 13020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37417 every 8 connection(s)
I20260806 18:44:03.326284 12897 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:03.329264 13021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:03.333832 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 12897
I20260806 18:44:03.333984 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:03.334257 12998 external_mini_cluster.cc:1428] Setting key 8c08b87ebba7507b7423048c2f0d9e5a
I20260806 18:44:03.335930 13021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: Bootstrap starting.
I20260806 18:44:03.338538 13021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:03.339680 13021 log.cc:824] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:03.340468 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:03.335904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:45145 (local address 127.0.0.1:37417)
0806 18:44:03.336435 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:03.336451 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:03.336498 (+ 47us) server_negotiation.cc:407] Connection header received
0806 18:44:03.337240 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:03.337259 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:03.337630 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:03.338010 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:03.338916 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:03.338924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:03.338942 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:03.338959 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:03.339035 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:03.339064 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:03.339184 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:03.339380 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 18:44:03.339559 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":162,"threads_started":1}
I20260806 18:44:03.342227 13021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: No bootstrap required, opened a new log
I20260806 18:44:03.343746 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:03.347554 13021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } }
I20260806 18:44:03.347932 13021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:03.348013 13021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c588c842c845abb5ca1ffa514ea3a9, State: Initialized, Role: FOLLOWER
I20260806 18:44:03.348304 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:03.346285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:49467 (local address 127.0.0.1:37417)
0806 18:44:03.346442 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:03.346447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:03.346711 (+ 264us) server_negotiation.cc:407] Connection header received
0806 18:44:03.346846 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:03.346849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:03.346887 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:03.346960 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:03.347748 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:03.347752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:03.347753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:03.347764 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:03.347820 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:03.347831 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:03.347938 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:03.348075 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 18:44:03.348126 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 18:44:03.348650 13021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } }
I20260806 18:44:03.348824 13021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:03.348913 13021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:03.349030 13021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:03.350165 13021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } }
I20260806 18:44:03.350575 13021 leader_election.cc:302] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71c588c842c845abb5ca1ffa514ea3a9; no voters:
I20260806 18:44:03.350927 13021 leader_election.cc:288] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:03.351075 13040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:03.351361 13040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [term 1 LEADER]: Becoming Leader. State: Replica: 71c588c842c845abb5ca1ffa514ea3a9, State: Running, Role: LEADER
I20260806 18:44:03.351792 13040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } }
I20260806 18:44:03.352384 13021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:03.353624 13041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71c588c842c845abb5ca1ffa514ea3a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } } }
I20260806 18:44:03.353773 13041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:03.354198 13042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71c588c842c845abb5ca1ffa514ea3a9. Latest consensus state: current_term: 1 leader_uuid: "71c588c842c845abb5ca1ffa514ea3a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c588c842c845abb5ca1ffa514ea3a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37417 } } }
I20260806 18:44:03.354375 13042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9 [sys.catalog]: This master's current role is: LEADER
W20260806 18:44:03.358170 13073 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:03.358311 13073 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:03.358398 13058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:03.359184 13058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:03.366514 13058 catalog_manager.cc:1347] Generated new cluster ID: 7c49caf19016405d91a48bb2219104a8
I20260806 18:44:03.366617 13058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:03.375195 13058 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:03.375687 13058 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:03.385156 13058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71c588c842c845abb5ca1ffa514ea3a9: Generated new TSK 0
I20260806 18:44:03.386189 13058 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:03.399288 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 12897
2026-08-06T18:44:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1729 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:03 dist-test-slave-j2vl krb5kdc[13082](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:03 dist-test-slave-j2vl krb5kdc[13082](info): set up 2 sockets
Aug 06 18:44:03 dist-test-slave-j2vl krb5kdc[13082](info): commencing operation
krb5kdc: starting...
W20260806 18:44:04.713577 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:04 dist-test-slave-j2vl krb5kdc[13082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:44:04.870740 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46599
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:04.999643 13103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:04.999981 13103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:05.000030 13103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:05.004436 13103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:05.004542 13103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:05.004563 13103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:05.004580 13103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:05.004597 13103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:05.010792 13103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46599
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:05.012101 13103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:05.013278 13103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:05.023005 13111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:05.023005 13114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:05.023072 13103 server_base.cc:1034] running on GCE node
W20260806 18:44:05.023032 13116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:05.024051 13103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:05.025782 13103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:05.027252 13103 hybrid_clock.cc:648] HybridClock initialized: now 1786041845027218 us; error 59 us; skew 500 ppm
Aug 06 18:44:05 dist-test-slave-j2vl krb5kdc[13082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041845, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:05.032294 13103 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:44:05.034137 13103 webserver.cc:460] Webserver started at http://127.0.0.1:38169/ using document root <none> and password file <none>
I20260806 18:44:05.034880 13103 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:05.034994 13103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:05.035243 13103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:05.038187 13103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "f4fdff4ca01d4c3eab1223b00a054af6"
format_stamp: "Formatted at 2026-08-06 18:44:05 on dist-test-slave-j2vl"
server_key: "ec64d418f3dabcef712c76a3c92c4486"
server_key_iv: "970a3704a1c339772bd26e719f46ecee"
server_key_version: "encryptionkey@0"
I20260806 18:44:05.039048 13103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "f4fdff4ca01d4c3eab1223b00a054af6"
format_stamp: "Formatted at 2026-08-06 18:44:05 on dist-test-slave-j2vl"
server_key: "ec64d418f3dabcef712c76a3c92c4486"
server_key_iv: "970a3704a1c339772bd26e719f46ecee"
server_key_version: "encryptionkey@0"
I20260806 18:44:05.043723 13103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:44:05.046810 13124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:05.048452 13103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 18:44:05.048648 13103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "f4fdff4ca01d4c3eab1223b00a054af6"
format_stamp: "Formatted at 2026-08-06 18:44:05 on dist-test-slave-j2vl"
server_key: "ec64d418f3dabcef712c76a3c92c4486"
server_key_iv: "970a3704a1c339772bd26e719f46ecee"
server_key_version: "encryptionkey@0"
I20260806 18:44:05.048816 13103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:05.069114 13103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:05.073240 13103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:05.073531 13103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:05.082592 13103 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46599
I20260806 18:44:05.082629 13208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46599 every 8 connection(s)
I20260806 18:44:05.083745 13103 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:05.086917 13210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:05.090641 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13103
I20260806 18:44:05.090822 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:05.091147 12998 external_mini_cluster.cc:1428] Setting key c64efe32d9f096c55b065c89e3066eac
I20260806 18:44:05.094861 13210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: Bootstrap starting.
I20260806 18:44:05.097818 13210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:05.098845 13210 log.cc:824] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:44:05 dist-test-slave-j2vl krb5kdc[13082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 18:44:05.102845 13210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: No bootstrap required, opened a new log
I20260806 18:44:05.107538 13210 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } }
I20260806 18:44:05.107872 13210 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:05.107944 13210 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fdff4ca01d4c3eab1223b00a054af6, State: Initialized, Role: FOLLOWER
I20260806 18:44:05.108530 13210 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } }
I20260806 18:44:05.108734 13210 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:05.108837 13210 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:05.108973 13210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:05.109514 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:05.092978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:46167 (local address 127.0.0.1:46599)
0806 18:44:05.093699 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:05.093717 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:05.093758 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:44:05.094477 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:05.094496 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:05.094913 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:05.095361 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:05.096237 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:05.097448 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:05.098447 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:05.098985 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:05.099167 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:05.103492 (+ 4325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:05.103498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:05.103515 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:05.103552 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:05.105695 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:05.106391 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:05.106397 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:05.106403 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:05.106561 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:05.106979 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:05.106983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:05.106985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:05.107472 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:05.107757 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:05.108104 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 18:44:05.108387 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":158,"threads_started":1}
I20260806 18:44:05.110572 13210 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } }
I20260806 18:44:05.111016 13210 leader_election.cc:302] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4fdff4ca01d4c3eab1223b00a054af6; no voters:
I20260806 18:44:05.111397 13210 leader_election.cc:288] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:05.111570 13219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:05.111841 13219 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [term 1 LEADER]: Becoming Leader. State: Replica: f4fdff4ca01d4c3eab1223b00a054af6, State: Running, Role: LEADER
I20260806 18:44:05.112257 13219 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } }
I20260806 18:44:05.112939 13210 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:05.113495 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:05.114218 13222 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4fdff4ca01d4c3eab1223b00a054af6. Latest consensus state: current_term: 1 leader_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } } }
I20260806 18:44:05.114353 13222 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:05.114773 13220 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4fdff4ca01d4c3eab1223b00a054af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46599 } } }
I20260806 18:44:05.114876 13220 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6 [sys.catalog]: This master's current role is: LEADER
W20260806 18:44:05.119663 13246 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:05.119776 13246 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:05.119856 13231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:05.120800 13231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:05.125017 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:05.116021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:53021 (local address 127.0.0.1:46599)
0806 18:44:05.116158 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:05.116165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:05.116528 (+ 363us) server_negotiation.cc:407] Connection header received
0806 18:44:05.116639 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:05.116644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:05.116709 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:05.116801 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:05.117814 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:05.118400 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:05.119380 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:05.119622 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:05.119740 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:05.121484 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:05.121494 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:05.121497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:05.121525 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:05.123076 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:05.123623 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:05.123632 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:05.123633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:05.123713 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:05.124071 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:05.124074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:05.124076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:05.124286 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:05.124444 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:05.124726 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 18:44:05.124833 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 18:44:05.128911 13231 catalog_manager.cc:1347] Generated new cluster ID: 66358fd15c6848ff88511e142899bd1a
I20260806 18:44:05.129024 13231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:05.142974 13231 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:05.144439 13231 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:05.152534 13231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4fdff4ca01d4c3eab1223b00a054af6: Generated new TSK 0
I20260806 18:44:05.153623 13231 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:05.166443 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13103
W20260806 18:44:05.181136 13080 connection.cc:535] client connection to 127.0.0.1:46599 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46599): Connection reset by peer (error 104)
2026-08-06T18:44:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1765 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:05 dist-test-slave-j2vl krb5kdc[13256](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:05 dist-test-slave-j2vl krb5kdc[13256](info): set up 2 sockets
Aug 06 18:44:05 dist-test-slave-j2vl krb5kdc[13256](info): commencing operation
krb5kdc: starting...
W20260806 18:44:06.466477 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:06 dist-test-slave-j2vl krb5kdc[13256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:44:06.617079 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41369
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:06.741518 13281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:06.741926 13281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:06.742018 13281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:06.746451 13281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:06.746582 13281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:06.746618 13281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:06.746662 13281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:06.746698 13281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:06.752718 13281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41369
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:06.754104 13281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:06.755306 13281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:06.764984 13294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:06.764969 13293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:06.764968 13300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:06.765048 13281 server_base.cc:1034] running on GCE node
I20260806 18:44:06.766023 13281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:06.767274 13281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:06.768500 13281 hybrid_clock.cc:648] HybridClock initialized: now 1786041846768471 us; error 46 us; skew 500 ppm
Aug 06 18:44:06 dist-test-slave-j2vl krb5kdc[13256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041846, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:06.775195 13281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:44:06.776327 13281 webserver.cc:460] Webserver started at http://127.0.0.1:45503/ using document root <none> and password file <none>
I20260806 18:44:06.776986 13281 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:06.777055 13281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:06.777305 13281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:06.779681 13281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "b1573d491ce74021a8955f942c266f36"
format_stamp: "Formatted at 2026-08-06 18:44:06 on dist-test-slave-j2vl"
server_key: "716e95aff304098508715b4d2d373256"
server_key_iv: "f10ff08f6ea6ce7ad2a83b9268942956"
server_key_version: "encryptionkey@0"
I20260806 18:44:06.780346 13281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "b1573d491ce74021a8955f942c266f36"
format_stamp: "Formatted at 2026-08-06 18:44:06 on dist-test-slave-j2vl"
server_key: "716e95aff304098508715b4d2d373256"
server_key_iv: "f10ff08f6ea6ce7ad2a83b9268942956"
server_key_version: "encryptionkey@0"
I20260806 18:44:06.784880 13281 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 18:44:06.788026 13311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:06.789760 13281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 18:44:06.789907 13281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "b1573d491ce74021a8955f942c266f36"
format_stamp: "Formatted at 2026-08-06 18:44:06 on dist-test-slave-j2vl"
server_key: "716e95aff304098508715b4d2d373256"
server_key_iv: "f10ff08f6ea6ce7ad2a83b9268942956"
server_key_version: "encryptionkey@0"
I20260806 18:44:06.790078 13281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:06.815930 13281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:06.819628 13281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:06.819883 13281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:06.828761 13281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41369
I20260806 18:44:06.828773 13381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41369 every 8 connection(s)
I20260806 18:44:06.830015 13281 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:06.833384 13382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:06.836422 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13281
I20260806 18:44:06.836588 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:06.836905 12998 external_mini_cluster.cc:1428] Setting key 5b44bf85d92e23af225b7167071d187c
I20260806 18:44:06.840687 13382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: Bootstrap starting.
I20260806 18:44:06.843286 13382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:06.844151 13382 log.cc:824] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:06.846601 13382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: No bootstrap required, opened a new log
I20260806 18:44:06.847352 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:06.838752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:43703 (local address 127.0.0.1:41369)
0806 18:44:06.839274 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:06.839290 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:06.839331 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:44:06.840057 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:06.840078 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:06.840462 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:06.840853 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:06.841316 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:06.842411 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:06.843361 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:06.844073 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:06.844279 (+ 206us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:06.845296 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:06.845302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:06.845318 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:06.845880 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:06.845941 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:06.845968 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:06.846122 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:06.846327 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 18:44:06.846496 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":160,"threads_started":1}
I20260806 18:44:06.850795 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:06.851156 13382 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } }
I20260806 18:44:06.851457 13382 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:06.851552 13382 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1573d491ce74021a8955f942c266f36, State: Initialized, Role: FOLLOWER
I20260806 18:44:06.852057 13382 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } }
I20260806 18:44:06.852257 13382 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:06.852335 13382 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:06.852454 13382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:06.853987 13382 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } }
I20260806 18:44:06.854491 13382 leader_election.cc:302] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1573d491ce74021a8955f942c266f36; no voters:
I20260806 18:44:06.855072 13382 leader_election.cc:288] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:06.855209 13400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:06.855502 13400 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [term 1 LEADER]: Becoming Leader. State: Replica: b1573d491ce74021a8955f942c266f36, State: Running, Role: LEADER
I20260806 18:44:06.855875 13400 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } }
I20260806 18:44:06.856724 13382 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:06.858227 13402 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1573d491ce74021a8955f942c266f36. Latest consensus state: current_term: 1 leader_uuid: "b1573d491ce74021a8955f942c266f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } } }
I20260806 18:44:06.858395 13402 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:06.858757 13401 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1573d491ce74021a8955f942c266f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1573d491ce74021a8955f942c266f36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41369 } } }
I20260806 18:44:06.858863 13401 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:06.859200 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:06.853642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:53725 (local address 127.0.0.1:41369)
0806 18:44:06.853818 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:06.853825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:06.853845 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:44:06.853895 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:06.853901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:06.853963 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:06.854064 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:06.854445 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:06.855405 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:06.856594 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:06.856970 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:06.857605 (+ 635us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:06.858258 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:06.858262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:06.858265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:06.858288 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:06.858319 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:06.858332 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:06.858426 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:06.858987 (+ 561us) server_negotiation.cc:299] Negotiation successful
0806 18:44:06.859027 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 18:44:06.862483 13421 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:06.862584 13421 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:06.862701 13414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:06.863595 13414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:06.870888 13414 catalog_manager.cc:1347] Generated new cluster ID: 7350a31347384390b321ba5ad7b9c97b
I20260806 18:44:06.870999 13414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:06.884840 13414 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:06.885994 13414 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:06.895622 13414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1573d491ce74021a8955f942c266f36: Generated new TSK 0
I20260806 18:44:06.896472 13414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:06.910589 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13281
W20260806 18:44:06.933758 13252 connection.cc:535] client connection to 127.0.0.1:41369 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41369): Connection reset by peer (error 104)
2026-08-06T18:44:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1752 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:06 dist-test-slave-j2vl krb5kdc[13428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:06 dist-test-slave-j2vl krb5kdc[13428](info): set up 2 sockets
Aug 06 18:44:07 dist-test-slave-j2vl krb5kdc[13428](info): commencing operation
krb5kdc: starting...
W20260806 18:44:08.196099 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:08 dist-test-slave-j2vl krb5kdc[13428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 18:44:08.347146 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38971
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:08.482070 13455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:08.482402 13455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:08.482450 13455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:08.486999 13455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:08.487102 13455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:08.487123 13455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:08.487142 13455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:08.487159 13455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:08.493669 13455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38971
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:08.494867 13455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:08.495936 13455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:08.505625 13462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:08.505684 13463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:08.505625 13466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:08.506080 13455 server_base.cc:1034] running on GCE node
I20260806 18:44:08.506786 13455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:08.508141 13455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:08.509428 13455 hybrid_clock.cc:648] HybridClock initialized: now 1786041848509406 us; error 58 us; skew 500 ppm
Aug 06 18:44:08 dist-test-slave-j2vl krb5kdc[13428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041848, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:08.513092 13455 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 18:44:08.514300 13455 webserver.cc:460] Webserver started at http://127.0.0.1:41525/ using document root <none> and password file <none>
I20260806 18:44:08.514966 13455 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:08.515067 13455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:08.515337 13455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:08.517804 13455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "fe2c08aa3f344f318050e57ead487537"
format_stamp: "Formatted at 2026-08-06 18:44:08 on dist-test-slave-j2vl"
server_key: "b4e02a204c79eb4068063039742c7d94"
server_key_iv: "72fe9a16606856481fdd26829aa431bc"
server_key_version: "encryptionkey@0"
I20260806 18:44:08.518473 13455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "fe2c08aa3f344f318050e57ead487537"
format_stamp: "Formatted at 2026-08-06 18:44:08 on dist-test-slave-j2vl"
server_key: "b4e02a204c79eb4068063039742c7d94"
server_key_iv: "72fe9a16606856481fdd26829aa431bc"
server_key_version: "encryptionkey@0"
I20260806 18:44:08.523746 13455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 18:44:08.527140 13478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:08.529274 13455 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 18:44:08.529701 13455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "fe2c08aa3f344f318050e57ead487537"
format_stamp: "Formatted at 2026-08-06 18:44:08 on dist-test-slave-j2vl"
server_key: "b4e02a204c79eb4068063039742c7d94"
server_key_iv: "72fe9a16606856481fdd26829aa431bc"
server_key_version: "encryptionkey@0"
I20260806 18:44:08.529891 13455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:08.535806 13455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:08.540262 13455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:08.540560 13455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:08.548992 13455 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38971
I20260806 18:44:08.549064 13551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38971 every 8 connection(s)
I20260806 18:44:08.550199 13455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:08.554176 13552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:08.557310 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13455
I20260806 18:44:08.557499 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:08.557799 12998 external_mini_cluster.cc:1428] Setting key 9eca000a6653c16a422c1a135e0657be
I20260806 18:44:08.561256 13552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537: Bootstrap starting.
I20260806 18:44:08.563885 13557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:08.559556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:55955 (local address 127.0.0.1:38971)
0806 18:44:08.560106 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:08.560123 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:08.560164 (+ 41us) server_negotiation.cc:407] Connection header received
0806 18:44:08.560847 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:08.560867 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:08.561188 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:08.561591 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:08.562513 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:08.562518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:08.562531 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:08.562543 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:08.562601 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:08.562622 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:08.562739 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:08.562873 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 18:44:08.563061 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":185,"threads_started":1}
I20260806 18:44:08.564244 13552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:08.565070 13552 log.cc:824] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:08.567128 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:08.567643 13552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537: No bootstrap required, opened a new log
I20260806 18:44:08.571538 13557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:08.569541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.139:54719 (local address 127.0.0.1:38971)
0806 18:44:08.569688 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:08.569694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:08.569987 (+ 293us) server_negotiation.cc:407] Connection header received
0806 18:44:08.570093 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:08.570095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:08.570129 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:08.570202 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:08.571054 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:08.571057 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:08.571059 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:08.571072 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:08.571099 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:08.571109 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:08.571191 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:08.571319 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 18:44:08.571362 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 18:44:08.572556 13552 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260806 18:44:08.572858 13552 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:08.572964 13552 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2c08aa3f344f318050e57ead487537, State: Initialized, Role: FOLLOWER
I20260806 18:44:08.573486 13552 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260806 18:44:08.573661 13552 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:08.573751 13552 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:08.573894 13552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:08.575004 13552 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260806 18:44:08.575403 13552 leader_election.cc:302] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe2c08aa3f344f318050e57ead487537; no voters:
I20260806 18:44:08.575786 13552 leader_election.cc:288] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:08.575989 13564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:08.576242 13564 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [term 1 LEADER]: Becoming Leader. State: Replica: fe2c08aa3f344f318050e57ead487537, State: Running, Role: LEADER
I20260806 18:44:08.576601 13564 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260806 18:44:08.577266 13552 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:08.578588 13567 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe2c08aa3f344f318050e57ead487537. Latest consensus state: current_term: 1 leader_uuid: "fe2c08aa3f344f318050e57ead487537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } } }
I20260806 18:44:08.578740 13567 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:08.579064 13566 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe2c08aa3f344f318050e57ead487537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2c08aa3f344f318050e57ead487537" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } } }
I20260806 18:44:08.579166 13575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:08.579187 13566 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:08.582882 13575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:08.589882 13575 catalog_manager.cc:1347] Generated new cluster ID: 4e037b41cf324bc1a89fb33e536e261c
I20260806 18:44:08.590003 13575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:08.604076 13575 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:08.604502 13575 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:08.621224 13575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe2c08aa3f344f318050e57ead487537: Generated new TSK 0
I20260806 18:44:08.622313 13575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:08.629972 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13455
2026-08-06T18:44:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1715 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:08 dist-test-slave-j2vl krb5kdc[13588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:08 dist-test-slave-j2vl krb5kdc[13588](info): set up 2 sockets
Aug 06 18:44:08 dist-test-slave-j2vl krb5kdc[13588](info): commencing operation
krb5kdc: starting...
W20260806 18:44:09.905424 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:10.061930 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33553
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:33553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:10.190369 13610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:10.190827 13610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:10.190946 13610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:10.195572 13610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:10.195698 13610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:10.195735 13610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:10.195775 13610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:10.195822 13610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:10.201886 13610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:33553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:10.203176 13610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:10.204299 13610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:10.214427 13618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:10.214565 13619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:10.214421 13621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:10.214753 13610 server_base.cc:1034] running on GCE node
I20260806 18:44:10.215577 13610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:10.216859 13610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:10.218062 13610 hybrid_clock.cc:648] HybridClock initialized: now 1786041850218032 us; error 59 us; skew 500 ppm
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:10.221475 13610 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:10.222604 13610 webserver.cc:460] Webserver started at http://127.12.177.190:37997/ using document root <none> and password file <none>
I20260806 18:44:10.223261 13610 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:10.223364 13610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:10.223608 13610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:10.226052 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "2f4b4e337a6f4306b7a25f91c0f81cea"
format_stamp: "Formatted at 2026-08-06 18:44:10 on dist-test-slave-j2vl"
server_key: "35f80e63d84026fdc9f54437c70d22fc"
server_key_iv: "dd7a22792048896f7c065289d627dfd4"
server_key_version: "encryptionkey@0"
I20260806 18:44:10.226754 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "2f4b4e337a6f4306b7a25f91c0f81cea"
format_stamp: "Formatted at 2026-08-06 18:44:10 on dist-test-slave-j2vl"
server_key: "35f80e63d84026fdc9f54437c70d22fc"
server_key_iv: "dd7a22792048896f7c065289d627dfd4"
server_key_version: "encryptionkey@0"
I20260806 18:44:10.231561 13610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 18:44:10.234848 13634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:10.236683 13610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 18:44:10.236899 13610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "2f4b4e337a6f4306b7a25f91c0f81cea"
format_stamp: "Formatted at 2026-08-06 18:44:10 on dist-test-slave-j2vl"
server_key: "35f80e63d84026fdc9f54437c70d22fc"
server_key_iv: "dd7a22792048896f7c065289d627dfd4"
server_key_version: "encryptionkey@0"
I20260806 18:44:10.237052 13610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:10.255374 13610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:10.259264 13610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:10.259510 13610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:10.268518 13610 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:33553
I20260806 18:44:10.268546 13713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:33553 every 8 connection(s)
I20260806 18:44:10.269794 13610 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:10.271307 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13610
I20260806 18:44:10.271579 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:10.272222 12998 external_mini_cluster.cc:1428] Setting key 1fd22449f26a0cd7e3df6e1ded2708d6
I20260806 18:44:10.273830 13714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:10.283082 13714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: Bootstrap starting.
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:10.286262 13714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:10.287323 13714 log.cc:824] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:10.290230 13714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: No bootstrap required, opened a new log
I20260806 18:44:10.291818 13720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:10.274940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34317 (local address 127.12.177.190:33553)
0806 18:44:10.275483 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:10.275504 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:10.275555 (+ 51us) server_negotiation.cc:407] Connection header received
0806 18:44:10.276523 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:10.276553 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:10.277069 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:10.277576 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:10.278431 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:10.280053 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:10.281330 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:10.282264 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:10.282483 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:10.285778 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:10.285786 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:10.285807 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:10.285850 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:10.288091 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:10.288765 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:10.288771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:10.288777 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:10.288913 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:10.289308 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:10.289312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:10.289313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:10.290040 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:10.290312 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:10.290662 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 18:44:10.290937 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":146,"threads_started":1}
I20260806 18:44:10.295265 13714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } }
I20260806 18:44:10.295791 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:10.295846 13714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:10.295994 13714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f4b4e337a6f4306b7a25f91c0f81cea, State: Initialized, Role: FOLLOWER
I20260806 18:44:10.296609 13714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } }
I20260806 18:44:10.296810 13714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:10.296886 13714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:10.296998 13714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:10.298450 13714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } }
I20260806 18:44:10.298889 13714 leader_election.cc:302] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f4b4e337a6f4306b7a25f91c0f81cea; no voters:
I20260806 18:44:10.299319 13714 leader_election.cc:288] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:10.299386 13730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:10.299613 13730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [term 1 LEADER]: Becoming Leader. State: Replica: 2f4b4e337a6f4306b7a25f91c0f81cea, State: Running, Role: LEADER
I20260806 18:44:10.299953 13730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } }
I20260806 18:44:10.300813 13714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:10.301819 13732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f4b4e337a6f4306b7a25f91c0f81cea. Latest consensus state: current_term: 1 leader_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } } }
I20260806 18:44:10.302229 13732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:10.302110 13731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f4b4e337a6f4306b7a25f91c0f81cea" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33553 } } }
I20260806 18:44:10.302580 13731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea [sys.catalog]: This master's current role is: LEADER
W20260806 18:44:10.306819 13749 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:10.306973 13749 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:10.307096 13742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:10.308164 13742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:10.308545 13720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:10.298471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48589 (local address 127.12.177.190:33553)
0806 18:44:10.298632 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:10.298637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:10.298865 (+ 228us) server_negotiation.cc:407] Connection header received
0806 18:44:10.298976 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:10.298978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:10.299055 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:10.299171 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:10.300119 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:10.300726 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:10.302049 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:10.302426 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:10.302522 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:10.304859 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:10.304862 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:10.304864 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:10.304891 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:10.306494 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:10.307158 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:10.307164 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:10.307166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:10.307264 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:10.307610 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:10.307613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:10.307615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:10.307828 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:10.307987 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:10.308265 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 18:44:10.308375 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 18:44:10.316304 13742 catalog_manager.cc:1347] Generated new cluster ID: a9a11750f7b847b39a2213568f6deadf
I20260806 18:44:10.316426 13742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:10.326073 13742 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:10.327087 13742 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:10.332604 13742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f4b4e337a6f4306b7a25f91c0f81cea: Generated new TSK 0
I20260806 18:44:10.333600 13742 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:10.346844 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13610
W20260806 18:44:10.366110 13586 connection.cc:535] client connection to 127.12.177.190:33553 recv error: Network error: failed to read from TLS socket (remote: 127.12.177.190:33553): Connection reset by peer (error 104)
2026-08-06T18:44:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1715 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13757](info): set up 2 sockets
Aug 06 18:44:10 dist-test-slave-j2vl krb5kdc[13757](info): commencing operation
krb5kdc: starting...
W20260806 18:44:11.618894 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:11 dist-test-slave-j2vl krb5kdc[13757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:11.766613 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33971
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:38851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:33971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:11.893944 13782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:11.894290 13782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:11.894340 13782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:11.898658 13782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:11.898753 13782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:11.898775 13782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:11.898803 13782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:11.898820 13782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:11.904649 13782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:38851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:33971
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:33971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:11.905896 13782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:11.907004 13782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:11.916436 13789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:11.916431 13788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:11.916431 13792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:11.916819 13782 server_base.cc:1034] running on GCE node
I20260806 18:44:11.917689 13782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:11.918951 13782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:11.920148 13782 hybrid_clock.cc:648] HybridClock initialized: now 1786041851920132 us; error 30 us; skew 500 ppm
Aug 06 18:44:11 dist-test-slave-j2vl krb5kdc[13757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041851, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:11.929304 13782 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:11.930469 13782 webserver.cc:460] Webserver started at http://127.12.177.190:38265/ using document root <none> and password file <none>
I20260806 18:44:11.931095 13782 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:11.931165 13782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:11.931382 13782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:11.933789 13782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "fefed13fe5c64b88a74edb348176ee1b"
format_stamp: "Formatted at 2026-08-06 18:44:11 on dist-test-slave-j2vl"
server_key: "70c1e2e75f576b4dd274ad17c0dd459b"
server_key_iv: "172ff719501215b4759cfc07dacc281f"
server_key_version: "encryptionkey@0"
I20260806 18:44:11.934396 13782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "fefed13fe5c64b88a74edb348176ee1b"
format_stamp: "Formatted at 2026-08-06 18:44:11 on dist-test-slave-j2vl"
server_key: "70c1e2e75f576b4dd274ad17c0dd459b"
server_key_iv: "172ff719501215b4759cfc07dacc281f"
server_key_version: "encryptionkey@0"
I20260806 18:44:11.938584 13782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:44:11.941531 13800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:11.943094 13782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:11.943287 13782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "fefed13fe5c64b88a74edb348176ee1b"
format_stamp: "Formatted at 2026-08-06 18:44:11 on dist-test-slave-j2vl"
server_key: "70c1e2e75f576b4dd274ad17c0dd459b"
server_key_iv: "172ff719501215b4759cfc07dacc281f"
server_key_version: "encryptionkey@0"
I20260806 18:44:11.943431 13782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:11.958925 13782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:11.962586 13782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:11.962819 13782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:11.970911 13782 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:33971
I20260806 18:44:11.970925 13876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:33971 every 8 connection(s)
I20260806 18:44:11.971984 13782 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:11.975204 13879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:11.975919 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13782
I20260806 18:44:11.976089 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:11.976384 12998 external_mini_cluster.cc:1428] Setting key 5aebc8cd757d4167f85e873deaf76fb1
I20260806 18:44:11.982695 13879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b: Bootstrap starting.
I20260806 18:44:11.985909 13879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:11.987006 13879 log.cc:824] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:11.987529 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:11.977881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33463 (local address 127.12.177.190:33971)
0806 18:44:11.978350 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:11.978372 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:11.978412 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:11.979107 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:11.979126 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:11.979506 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:11.979819 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:11.980304 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:11.981779 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:11.983070 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:11.983801 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:11.983990 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:11.985039 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:11.985045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:11.985063 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:11.985661 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:11.985753 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:11.985792 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:11.985964 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:11.986231 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 18:44:11.986416 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":148,"threads_started":1}
I20260806 18:44:11.989717 13879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b: No bootstrap required, opened a new log
I20260806 18:44:11.990957 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:11.994457 13879 raft_consensus.cc:348] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } }
I20260806 18:44:11.994776 13879 raft_consensus.cc:374] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:11.994817 13879 raft_consensus.cc:729] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefed13fe5c64b88a74edb348176ee1b, State: Initialized, Role: FOLLOWER
I20260806 18:44:11.995445 13879 consensus_queue.cc:260] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } }
I20260806 18:44:11.995637 13879 raft_consensus.cc:388] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:11.995712 13879 raft_consensus.cc:482] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:11.995824 13879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:11.997197 13879 raft_consensus.cc:504] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } }
I20260806 18:44:11.997712 13879 leader_election.cc:302] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fefed13fe5c64b88a74edb348176ee1b; no voters:
I20260806 18:44:11.998206 13879 leader_election.cc:288] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:11.998355 13889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:11.998392 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:11.993253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49491 (local address 127.12.177.190:33971)
0806 18:44:11.993447 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:11.993452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:11.993742 (+ 290us) server_negotiation.cc:407] Connection header received
0806 18:44:11.993928 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:11.993931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:11.993982 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:11.994063 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:11.994414 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:11.995134 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:11.996290 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:11.996556 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:11.996649 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:11.997748 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:11.997751 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:11.997753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:11.997768 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:11.997808 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:11.997819 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:11.997943 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:11.998129 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 18:44:11.998173 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 18:44:11.998689 13889 raft_consensus.cc:686] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [term 1 LEADER]: Becoming Leader. State: Replica: fefed13fe5c64b88a74edb348176ee1b, State: Running, Role: LEADER
I20260806 18:44:11.999114 13889 consensus_queue.cc:237] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } }
I20260806 18:44:11.999845 13879 sys_catalog.cc:564] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:12.001228 13892 sys_catalog.cc:455] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fefed13fe5c64b88a74edb348176ee1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } } }
I20260806 18:44:12.001425 13892 sys_catalog.cc:458] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:12.001798 13891 sys_catalog.cc:455] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fefed13fe5c64b88a74edb348176ee1b. Latest consensus state: current_term: 1 leader_uuid: "fefed13fe5c64b88a74edb348176ee1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fefed13fe5c64b88a74edb348176ee1b" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 33971 } } }
I20260806 18:44:12.001924 13891 sys_catalog.cc:458] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:12.002146 13901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:12.005679 13901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:12.013748 13901 catalog_manager.cc:1347] Generated new cluster ID: 87fbb01dede54b46b507986b22c71033
I20260806 18:44:12.013861 13901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:12.026222 13901 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:12.027693 13901 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:12.034758 13901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fefed13fe5c64b88a74edb348176ee1b: Generated new TSK 0
I20260806 18:44:12.035596 13901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:12.044854 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13782
W20260806 18:44:12.059508 13753 connection.cc:535] client connection to 127.12.177.190:33971 recv error: Network error: failed to read from TLS socket (remote: 127.12.177.190:33971): Connection reset by peer (error 104)
2026-08-06T18:44:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1693 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:12 dist-test-slave-j2vl krb5kdc[13914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:12 dist-test-slave-j2vl krb5kdc[13914](info): set up 2 sockets
Aug 06 18:44:12 dist-test-slave-j2vl krb5kdc[13914](info): commencing operation
krb5kdc: starting...
W20260806 18:44:13.321202 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:13 dist-test-slave-j2vl krb5kdc[13914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:13.477806 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:43837
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:43837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:13.600831 13934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:13.601186 13934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:13.601263 13934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:13.605569 13934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:13.605690 13934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:13.605731 13934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:13.605770 13934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:13.605811 13934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:13.611711 13934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:43837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:43837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:13.613059 13934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:13.614248 13934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:13.624442 13945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:13.624432 13944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:13.624432 13950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:13.624908 13934 server_base.cc:1034] running on GCE node
I20260806 18:44:13.625715 13934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:13.627071 13934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:13.628260 13934 hybrid_clock.cc:648] HybridClock initialized: now 1786041853628241 us; error 41 us; skew 500 ppm
Aug 06 18:44:13 dist-test-slave-j2vl krb5kdc[13914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041853, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:13.631855 13934 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:13.633096 13934 webserver.cc:460] Webserver started at http://127.12.177.190:43439/ using document root <none> and password file <none>
I20260806 18:44:13.633839 13934 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:13.633955 13934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:13.634238 13934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:13.636656 13934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "a82893273ccf4fe8a0f59e574534b426"
format_stamp: "Formatted at 2026-08-06 18:44:13 on dist-test-slave-j2vl"
server_key: "074df258522d7de5221b202e3aee0d3e"
server_key_iv: "09bd74195002af76000af9ae7ef13178"
server_key_version: "encryptionkey@0"
I20260806 18:44:13.637326 13934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "a82893273ccf4fe8a0f59e574534b426"
format_stamp: "Formatted at 2026-08-06 18:44:13 on dist-test-slave-j2vl"
server_key: "074df258522d7de5221b202e3aee0d3e"
server_key_iv: "09bd74195002af76000af9ae7ef13178"
server_key_version: "encryptionkey@0"
I20260806 18:44:13.641863 13934 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:44:13.644892 13960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:13.646401 13934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:13.646570 13934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "a82893273ccf4fe8a0f59e574534b426"
format_stamp: "Formatted at 2026-08-06 18:44:13 on dist-test-slave-j2vl"
server_key: "074df258522d7de5221b202e3aee0d3e"
server_key_iv: "09bd74195002af76000af9ae7ef13178"
server_key_version: "encryptionkey@0"
I20260806 18:44:13.646710 13934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:13.651714 13934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:13.655449 13934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:13.655704 13934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:13.663517 13934 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:43837
I20260806 18:44:13.663547 14046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:43837 every 8 connection(s)
I20260806 18:44:13.664611 13934 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:13.666416 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 13934
I20260806 18:44:13.666568 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:13.666868 12998 external_mini_cluster.cc:1428] Setting key 2d67d872780757cf08310a0410c42714
I20260806 18:44:13.668069 14047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:13.672955 14050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:13.668395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55115 (local address 127.12.177.190:43837)
0806 18:44:13.668861 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:13.668883 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:13.668929 (+ 46us) server_negotiation.cc:407] Connection header received
0806 18:44:13.669856 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:13.669879 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:13.670255 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:13.670648 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:13.671442 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:13.671450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:13.671466 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:13.671479 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:13.671560 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:13.671589 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:13.671738 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:13.671819 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 18:44:13.671983 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":132,"threads_started":1}
I20260806 18:44:13.675590 14047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426: Bootstrap starting.
I20260806 18:44:13.676144 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:13.678072 14047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:13.679108 14047 log.cc:824] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:13.680151 14050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:13.678373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49539 (local address 127.12.177.190:43837)
0806 18:44:13.678520 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:13.678524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:13.678705 (+ 181us) server_negotiation.cc:407] Connection header received
0806 18:44:13.678847 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:13.678849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:13.678883 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:13.678952 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:13.679755 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:13.679759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:13.679762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:13.679775 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:13.679801 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:13.679818 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:13.679923 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:13.679962 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 18:44:13.680005 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:44:13.681645 14047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426: No bootstrap required, opened a new log
I20260806 18:44:13.685672 14047 raft_consensus.cc:348] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } }
I20260806 18:44:13.685951 14047 raft_consensus.cc:374] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:13.685988 14047 raft_consensus.cc:729] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a82893273ccf4fe8a0f59e574534b426, State: Initialized, Role: FOLLOWER
I20260806 18:44:13.686376 14047 consensus_queue.cc:260] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } }
I20260806 18:44:13.686488 14047 raft_consensus.cc:388] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:13.686535 14047 raft_consensus.cc:482] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:13.686607 14047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:13.687608 14047 raft_consensus.cc:504] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } }
I20260806 18:44:13.687935 14047 leader_election.cc:302] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a82893273ccf4fe8a0f59e574534b426; no voters:
I20260806 18:44:13.688238 14047 leader_election.cc:288] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:13.688406 14060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:13.688651 14060 raft_consensus.cc:686] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [term 1 LEADER]: Becoming Leader. State: Replica: a82893273ccf4fe8a0f59e574534b426, State: Running, Role: LEADER
I20260806 18:44:13.688997 14060 consensus_queue.cc:237] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } }
I20260806 18:44:13.689731 14047 sys_catalog.cc:564] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:13.691000 14064 sys_catalog.cc:455] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a82893273ccf4fe8a0f59e574534b426. Latest consensus state: current_term: 1 leader_uuid: "a82893273ccf4fe8a0f59e574534b426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } } }
I20260806 18:44:13.691195 14064 sys_catalog.cc:458] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:13.691009 14061 sys_catalog.cc:455] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a82893273ccf4fe8a0f59e574534b426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a82893273ccf4fe8a0f59e574534b426" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 43837 } } }
I20260806 18:44:13.691324 14061 sys_catalog.cc:458] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:13.691709 14075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:13.694813 14075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:13.701519 14075 catalog_manager.cc:1347] Generated new cluster ID: 75a24f2aa2f04c3c9c843500045f7738
I20260806 18:44:13.701615 14075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:13.728189 14075 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:13.728643 14075 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:13.741101 14075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a82893273ccf4fe8a0f59e574534b426: Generated new TSK 0
I20260806 18:44:13.742018 14075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:13.757326 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 13934
2026-08-06T18:44:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1711 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:13 dist-test-slave-j2vl krb5kdc[14091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:13 dist-test-slave-j2vl krb5kdc[14091](info): set up 2 sockets
Aug 06 18:44:13 dist-test-slave-j2vl krb5kdc[14091](info): commencing operation
krb5kdc: starting...
W20260806 18:44:15.033003 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:15.192651 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37231
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:15.320091 14123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:15.320446 14123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:15.320497 14123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:15.325034 14123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:15.325134 14123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:15.325156 14123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:15.325176 14123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:15.325192 14123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:15.331293 14123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:15.332638 14123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:15.333855 14123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:15.343922 14133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:15.343977 14132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:15.343966 14135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:15.344651 14123 server_base.cc:1034] running on GCE node
I20260806 18:44:15.345474 14123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:15.346762 14123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:15.347958 14123 hybrid_clock.cc:648] HybridClock initialized: now 1786041855347928 us; error 48 us; skew 500 ppm
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041855, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:15.351147 14123 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:15.352298 14123 webserver.cc:460] Webserver started at http://127.12.177.190:38411/ using document root <none> and password file <none>
I20260806 18:44:15.352945 14123 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:15.353047 14123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:15.353299 14123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:15.355654 14123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "19b90d671e2542cdb51bb8b5dbfb975c"
format_stamp: "Formatted at 2026-08-06 18:44:15 on dist-test-slave-j2vl"
server_key: "be5fa28b7a6b9273e50800736e564ab5"
server_key_iv: "2f8c97d55162aa1025d0c0321e2ff218"
server_key_version: "encryptionkey@0"
I20260806 18:44:15.356300 14123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "19b90d671e2542cdb51bb8b5dbfb975c"
format_stamp: "Formatted at 2026-08-06 18:44:15 on dist-test-slave-j2vl"
server_key: "be5fa28b7a6b9273e50800736e564ab5"
server_key_iv: "2f8c97d55162aa1025d0c0321e2ff218"
server_key_version: "encryptionkey@0"
I20260806 18:44:15.361109 14123 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 18:44:15.364501 14144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:15.366142 14123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:15.366346 14123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "19b90d671e2542cdb51bb8b5dbfb975c"
format_stamp: "Formatted at 2026-08-06 18:44:15 on dist-test-slave-j2vl"
server_key: "be5fa28b7a6b9273e50800736e564ab5"
server_key_iv: "2f8c97d55162aa1025d0c0321e2ff218"
server_key_version: "encryptionkey@0"
I20260806 18:44:15.366498 14123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:15.380518 14123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:15.384320 14123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:15.384574 14123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:15.392812 14123 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:37231
I20260806 18:44:15.393086 14226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:37231 every 8 connection(s)
I20260806 18:44:15.393985 14123 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:15.396966 14227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:15.402534 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14123
I20260806 18:44:15.402710 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:15.403005 12998 external_mini_cluster.cc:1428] Setting key 947588a15041b859cf222a59447c609f
I20260806 18:44:15.403380 14227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: Bootstrap starting.
I20260806 18:44:15.406236 14227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:15.407280 14227 log.cc:824] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:15.409679 14227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: No bootstrap required, opened a new log
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:15.414671 14227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } }
I20260806 18:44:15.415068 14227 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:15.415140 14227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b90d671e2542cdb51bb8b5dbfb975c, State: Initialized, Role: FOLLOWER
I20260806 18:44:15.415716 14227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } }
I20260806 18:44:15.415941 14227 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:15.416019 14227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:15.416129 14227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:15.417233 14227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } }
I20260806 18:44:15.417644 14227 leader_election.cc:302] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19b90d671e2542cdb51bb8b5dbfb975c; no voters:
I20260806 18:44:15.418068 14227 leader_election.cc:288] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:15.418126 14235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:15.418349 14235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [term 1 LEADER]: Becoming Leader. State: Replica: 19b90d671e2542cdb51bb8b5dbfb975c, State: Running, Role: LEADER
I20260806 18:44:15.418789 14235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } }
I20260806 18:44:15.419662 14227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:15.420696 14238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19b90d671e2542cdb51bb8b5dbfb975c. Latest consensus state: current_term: 1 leader_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } } }
I20260806 18:44:15.420840 14238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:15.421003 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:15.404594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49253 (local address 127.12.177.190:37231)
0806 18:44:15.405086 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:15.405104 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:15.405142 (+ 38us) server_negotiation.cc:407] Connection header received
0806 18:44:15.405920 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:15.405940 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:15.406301 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:15.406649 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:15.407632 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:15.408635 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:15.409828 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:15.410324 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:15.410450 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:15.413529 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:15.413539 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:15.413564 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:15.413619 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:15.416723 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:15.417243 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:15.417250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:15.417257 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:15.417468 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:15.417778 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:15.417782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:15.417784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:15.418334 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:15.419250 (+ 916us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:15.419479 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 18:44:15.419840 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":168,"threads_started":1}
I20260806 18:44:15.421134 14240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b90d671e2542cdb51bb8b5dbfb975c" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37231 } } }
I20260806 18:44:15.421216 14240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:15.424764 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 18:44:15.425621 14262 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:15.425720 14262 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:15.427361 14252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:15.428208 14252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:15.435832 14252 catalog_manager.cc:1347] Generated new cluster ID: a59f5c23775447589069ede2b9ef8c75
I20260806 18:44:15.435918 14252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:15.439693 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:15.429937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33841 (local address 127.12.177.190:37231)
0806 18:44:15.430070 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:15.430075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:15.430621 (+ 546us) server_negotiation.cc:407] Connection header received
0806 18:44:15.430793 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:15.430797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:15.430851 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:15.430941 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:15.431685 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:15.432224 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:15.433104 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:15.433491 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:15.433575 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:15.435663 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:15.435669 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:15.435678 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:15.435713 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:15.437790 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:15.438330 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:15.438335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:15.438340 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:15.438427 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:15.438742 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:15.438745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:15.438746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:15.438947 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:15.439102 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:15.439369 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 18:44:15.439500 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 18:44:15.459107 14252 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:15.460187 14252 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:15.467161 14252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19b90d671e2542cdb51bb8b5dbfb975c: Generated new TSK 0
I20260806 18:44:15.468030 14252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:15.476456 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14123
2026-08-06T18:44:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1723 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14278](info): set up 2 sockets
Aug 06 18:44:15 dist-test-slave-j2vl krb5kdc[14278](info): commencing operation
krb5kdc: starting...
W20260806 18:44:16.789561 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:16 dist-test-slave-j2vl krb5kdc[14278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:16.945924 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:38097
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:37823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:38097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:17.075713 14295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:17.076120 14295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:17.076210 14295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:17.081959 14295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:17.082082 14295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:17.082122 14295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:17.082182 14295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:17.082233 14295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:17.088034 14295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:37823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:38097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:38097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:17.089231 14295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:17.090334 14295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:17.099910 14304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:17.099912 14302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:17.099910 14306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:17.099977 14295 server_base.cc:1034] running on GCE node
I20260806 18:44:17.100963 14295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:17.102358 14295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:17.103602 14295 hybrid_clock.cc:648] HybridClock initialized: now 1786041857103573 us; error 38 us; skew 500 ppm
Aug 06 18:44:17 dist-test-slave-j2vl krb5kdc[14278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041857, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:17.112603 14295 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:17.113827 14295 webserver.cc:460] Webserver started at http://127.12.177.190:34621/ using document root <none> and password file <none>
I20260806 18:44:17.114459 14295 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:17.114531 14295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:17.114769 14295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:17.117094 14295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "6cce8b0f523c44e7b303cb2f3e94fab6"
format_stamp: "Formatted at 2026-08-06 18:44:17 on dist-test-slave-j2vl"
server_key: "ec768d5598531c90bc88070d11c5f6ec"
server_key_iv: "680fb1386490e64c7d7ab6899691e79b"
server_key_version: "encryptionkey@0"
I20260806 18:44:17.117822 14295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "6cce8b0f523c44e7b303cb2f3e94fab6"
format_stamp: "Formatted at 2026-08-06 18:44:17 on dist-test-slave-j2vl"
server_key: "ec768d5598531c90bc88070d11c5f6ec"
server_key_iv: "680fb1386490e64c7d7ab6899691e79b"
server_key_version: "encryptionkey@0"
I20260806 18:44:17.122272 14295 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:44:17.125463 14316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:17.127067 14295 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:17.127230 14295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "6cce8b0f523c44e7b303cb2f3e94fab6"
format_stamp: "Formatted at 2026-08-06 18:44:17 on dist-test-slave-j2vl"
server_key: "ec768d5598531c90bc88070d11c5f6ec"
server_key_iv: "680fb1386490e64c7d7ab6899691e79b"
server_key_version: "encryptionkey@0"
I20260806 18:44:17.127429 14295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:17.151059 14295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:17.154438 14295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:17.154659 14295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:17.163193 14295 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:38097
I20260806 18:44:17.163221 14395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:38097 every 8 connection(s)
I20260806 18:44:17.164338 14295 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:17.165359 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14295
I20260806 18:44:17.165517 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:17.165848 12998 external_mini_cluster.cc:1428] Setting key c65ca77fb27936ba96a22d273befdcc6
I20260806 18:44:17.168148 14396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:17.174405 14396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6: Bootstrap starting.
I20260806 18:44:17.175900 14400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:17.167476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43517 (local address 127.12.177.190:38097)
0806 18:44:17.168012 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:17.168028 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:17.168068 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:17.168802 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:17.168820 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:17.169193 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:17.169628 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:17.170069 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:17.171113 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:17.172174 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:17.172672 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:17.172867 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:17.173986 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:17.173992 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:17.174007 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:17.174454 (+ 447us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:17.174554 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:17.174594 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:17.174702 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:17.174920 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 18:44:17.175156 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":168,"threads_started":1}
I20260806 18:44:17.177062 14396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:17.178053 14396 log.cc:824] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:17.179149 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:17.180348 14396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6: No bootstrap required, opened a new log
I20260806 18:44:17.184800 14396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } }
I20260806 18:44:17.185190 14396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:17.185276 14396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cce8b0f523c44e7b303cb2f3e94fab6, State: Initialized, Role: FOLLOWER
I20260806 18:44:17.185879 14396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } }
I20260806 18:44:17.186076 14396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:17.186158 14396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:17.186275 14396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:17.186622 14400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:17.181366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60113 (local address 127.12.177.190:38097)
0806 18:44:17.181493 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:17.181498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:17.181700 (+ 202us) server_negotiation.cc:407] Connection header received
0806 18:44:17.181800 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:17.181804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:17.181853 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:17.181936 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:17.182203 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:17.183751 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:17.184639 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:17.184998 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:17.185112 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:17.186141 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:17.186147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:17.186153 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:17.186170 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:17.186202 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:17.186219 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:17.186288 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:17.186412 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 18:44:17.186472 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 18:44:17.187682 14396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } }
I20260806 18:44:17.188091 14396 leader_election.cc:302] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cce8b0f523c44e7b303cb2f3e94fab6; no voters:
I20260806 18:44:17.188421 14396 leader_election.cc:288] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:17.188541 14412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:17.188795 14412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [term 1 LEADER]: Becoming Leader. State: Replica: 6cce8b0f523c44e7b303cb2f3e94fab6, State: Running, Role: LEADER
I20260806 18:44:17.189247 14412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } }
I20260806 18:44:17.189988 14396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:17.191125 14413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } } }
I20260806 18:44:17.191272 14413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:17.191725 14428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:17.191679 14416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cce8b0f523c44e7b303cb2f3e94fab6. Latest consensus state: current_term: 1 leader_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cce8b0f523c44e7b303cb2f3e94fab6" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38097 } } }
I20260806 18:44:17.191860 14416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:17.194891 14428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:17.200826 14428 catalog_manager.cc:1347] Generated new cluster ID: adeaeba9ed6d4e5aacb8598ebdae37eb
I20260806 18:44:17.200927 14428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:17.224740 14428 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:17.226279 14428 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:17.233733 14428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cce8b0f523c44e7b303cb2f3e94fab6: Generated new TSK 0
I20260806 18:44:17.234656 14428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:17.243855 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14295
2026-08-06T18:44:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1771 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:17 dist-test-slave-j2vl krb5kdc[14445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:17 dist-test-slave-j2vl krb5kdc[14445](info): set up 2 sockets
Aug 06 18:44:17 dist-test-slave-j2vl krb5kdc[14445](info): commencing operation
krb5kdc: starting...
W20260806 18:44:18.533910 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:18 dist-test-slave-j2vl krb5kdc[14445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:18.685789 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46771
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:45511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:46771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:18.818064 14459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:18.818392 14459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:18.818437 14459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:18.823207 14459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:18.823299 14459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:18.823321 14459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:18.823340 14459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:18.823356 14459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:18.829496 14459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:45511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:46771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:46771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:18.830677 14459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:18.831739 14459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:18.841678 14466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:18.841868 14459 server_base.cc:1034] running on GCE node
W20260806 18:44:18.841678 14465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:18.841678 14472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:18.842646 14459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:18.843894 14459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:18.845088 14459 hybrid_clock.cc:648] HybridClock initialized: now 1786041858845072 us; error 35 us; skew 500 ppm
Aug 06 18:44:18 dist-test-slave-j2vl krb5kdc[14445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041858, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:18.848248 14459 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:18.849234 14459 webserver.cc:460] Webserver started at http://127.12.177.190:33733/ using document root <none> and password file <none>
I20260806 18:44:18.849895 14459 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:18.849999 14459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:18.850253 14459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:18.852480 14459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "b2ed011492d041d9ada6388c2da7a4f7"
format_stamp: "Formatted at 2026-08-06 18:44:18 on dist-test-slave-j2vl"
server_key: "3f759142ba5d6df7bb8093b7c5854f69"
server_key_iv: "bd058b6f3217ba1930cefbf3df5b5192"
server_key_version: "encryptionkey@0"
I20260806 18:44:18.853111 14459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "b2ed011492d041d9ada6388c2da7a4f7"
format_stamp: "Formatted at 2026-08-06 18:44:18 on dist-test-slave-j2vl"
server_key: "3f759142ba5d6df7bb8093b7c5854f69"
server_key_iv: "bd058b6f3217ba1930cefbf3df5b5192"
server_key_version: "encryptionkey@0"
I20260806 18:44:18.857478 14459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 18:44:18.860405 14479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:18.861975 14459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:18.862141 14459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "b2ed011492d041d9ada6388c2da7a4f7"
format_stamp: "Formatted at 2026-08-06 18:44:18 on dist-test-slave-j2vl"
server_key: "3f759142ba5d6df7bb8093b7c5854f69"
server_key_iv: "bd058b6f3217ba1930cefbf3df5b5192"
server_key_version: "encryptionkey@0"
I20260806 18:44:18.862278 14459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:18.867363 14459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:18.871383 14459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:18.871646 14459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:18.880470 14459 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:46771
I20260806 18:44:18.880534 14552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:46771 every 8 connection(s)
I20260806 18:44:18.881662 14459 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:18.884553 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14459
I20260806 18:44:18.884682 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:18.884894 14555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:18.885079 12998 external_mini_cluster.cc:1428] Setting key 155fbb68907747dd91aab99defaf6543
I20260806 18:44:18.891714 14565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:18.886655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44859 (local address 127.12.177.190:46771)
0806 18:44:18.887133 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:18.887152 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:18.887198 (+ 46us) server_negotiation.cc:407] Connection header received
0806 18:44:18.888215 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:18.888241 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:18.888633 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:18.889045 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:18.890072 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:18.890078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:18.890093 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:18.890106 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:18.890180 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:18.890212 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:18.890379 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:18.890454 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 18:44:18.890616 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":134,"threads_started":1}
I20260806 18:44:18.893491 14555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7: Bootstrap starting.
I20260806 18:44:18.895335 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:18.896590 14555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:18.897651 14555 log.cc:824] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:18.900071 14565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:18.898002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38497 (local address 127.12.177.190:46771)
0806 18:44:18.898156 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:18.898161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:18.898355 (+ 194us) server_negotiation.cc:407] Connection header received
0806 18:44:18.898448 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:18.898451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:18.898493 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:18.898603 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:18.899544 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:18.899550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:18.899555 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 18:44:18.899571 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:18.899606 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 18:44:18.899623 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:18.899721 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:18.899855 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 18:44:18.899892 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:44:18.900625 14555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7: No bootstrap required, opened a new log
I20260806 18:44:18.905208 14555 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } }
I20260806 18:44:18.905614 14555 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 18:44:18.905714 14555 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ed011492d041d9ada6388c2da7a4f7, State: Initialized, Role: FOLLOWER
I20260806 18:44:18.906286 14555 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } }
I20260806 18:44:18.906498 14555 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 18:44:18.906596 14555 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 18:44:18.906715 14555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:18.907908 14555 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } }
I20260806 18:44:18.908320 14555 leader_election.cc:302] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2ed011492d041d9ada6388c2da7a4f7; no voters:
I20260806 18:44:18.908725 14555 leader_election.cc:288] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 18:44:18.908922 14574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:18.909178 14574 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [term 1 LEADER]: Becoming Leader. State: Replica: b2ed011492d041d9ada6388c2da7a4f7, State: Running, Role: LEADER
I20260806 18:44:18.909586 14574 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } }
I20260806 18:44:18.910207 14555 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:18.911597 14576 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2ed011492d041d9ada6388c2da7a4f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } } }
I20260806 18:44:18.911751 14576 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:18.911573 14577 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2ed011492d041d9ada6388c2da7a4f7. Latest consensus state: current_term: 1 leader_uuid: "b2ed011492d041d9ada6388c2da7a4f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ed011492d041d9ada6388c2da7a4f7" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 46771 } } }
I20260806 18:44:18.912046 14577 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:18.912213 14585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:18.915464 14585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:18.922818 14585 catalog_manager.cc:1347] Generated new cluster ID: 07f97f92fae946db8d15e795dbd771e7
I20260806 18:44:18.922930 14585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:18.941699 14585 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:18.942088 14585 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:18.949908 14585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2ed011492d041d9ada6388c2da7a4f7: Generated new TSK 0
I20260806 18:44:18.950767 14585 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 18:44:18.960762 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14459
2026-08-06T18:44:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1704 ms)
[----------] 18 tests from AuthTokenIssuingTest (31442 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:19 dist-test-slave-j2vl krb5kdc[14605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:19 dist-test-slave-j2vl krb5kdc[14605](info): set up 2 sockets
Aug 06 18:44:19 dist-test-slave-j2vl krb5kdc[14605](info): commencing operation
krb5kdc: starting...
W20260806 18:44:20.241117 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:20.389487 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:38245
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:32945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:20.517705 14622 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:20.518103 14622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:20.518172 14622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:20.518255 14622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:20.522652 14622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:20.522774 14622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:20.523085 14622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:20.523149 14622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:20.523190 14622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:20.529598 14622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:32945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:38245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:20.530961 14622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:20.532239 14622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:20.542202 14633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:20.542196 14628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:20.542229 14627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:20.542495 14622 server_base.cc:1034] running on GCE node
I20260806 18:44:20.543322 14622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:20.544575 14622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:20.545771 14622 hybrid_clock.cc:648] HybridClock initialized: now 1786041860545752 us; error 67 us; skew 500 ppm
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:20.548817 14622 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:20.549912 14622 webserver.cc:460] Webserver started at http://127.12.177.190:33223/ using document root <none> and password file <none>
I20260806 18:44:20.550535 14622 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:20.550604 14622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:20.550850 14622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:20.553107 14622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "787a8635f6674c3cbb7b4a212f7c8bc0"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "55cac52615d2d29f6c218fe4a98885ac"
server_key_iv: "2ef6c2b170eeaa098f2aaf68340765ee"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.553825 14622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "787a8635f6674c3cbb7b4a212f7c8bc0"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "55cac52615d2d29f6c218fe4a98885ac"
server_key_iv: "2ef6c2b170eeaa098f2aaf68340765ee"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.558092 14622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:44:20.560984 14643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:20.562583 14622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:20.562760 14622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "787a8635f6674c3cbb7b4a212f7c8bc0"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "55cac52615d2d29f6c218fe4a98885ac"
server_key_iv: "2ef6c2b170eeaa098f2aaf68340765ee"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.562914 14622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:20.585664 14622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:20.589329 14622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:20.589619 14622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:20.597452 14622 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:38245
I20260806 18:44:20.597790 14717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:38245 every 8 connection(s)
I20260806 18:44:20.598641 14622 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:20.601784 14718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:20.606223 14718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:20.608342 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14622
I20260806 18:44:20.608523 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:20.608826 12998 external_mini_cluster.cc:1428] Setting key 7fe0ef0c3ff8f8b5460ba5ce83a2af86
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.189@KRBTEST.COM" created.
I20260806 18:44:20.624120 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.608956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53598 (local address 127.12.177.190:38245)
0806 18:44:20.609663 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:20.609679 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:20.609734 (+ 55us) server_negotiation.cc:407] Connection header received
0806 18:44:20.610961 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:20.610969 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:20.611200 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:20.611374 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:20.612606 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.613572 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.615239 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.615619 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.615735 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.618654 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:20.618660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:20.618671 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:20.618693 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:20.620464 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.621084 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.621089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.621090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.621206 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.621580 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.621585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.621587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.622069 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:20.622222 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:20.622614 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 18:44:20.622892 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"spinlock_wait_cycles":1792,"thread_start_us":200,"threads_started":1}
I20260806 18:44:20.624120 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.608956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:38245 (local address 127.0.0.1:53598)
0806 18:44:20.609551 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.609609 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:20.610576 (+ 967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:20.611431 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:20.611440 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:20.611989 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:20.612425 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.612450 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.613707 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.613714 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.615087 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.615103 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.615802 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.615809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.615956 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.616627 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:20.616654 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:20.618485 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:20.620608 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.620618 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.620630 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.620917 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.621315 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.621319 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.621321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.621493 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.622198 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:20.622205 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:20.622359 (+ 154us) client_negotiation.cc:769] Sending connection context
0806 18:44:20.622539 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 18:44:20.622979 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":113,"thread_start_us":160,"threads_started":1}
I20260806 18:44:20.627269 14718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:20.628340 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.627870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45894)
0806 18:44:20.628063 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.628183 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 18:44:20.628664 14649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
I20260806 18:44:20.629913 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.629537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45900)
0806 18:44:20.629712 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.629796 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 18:44:20.630127 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:40101: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
I20260806 18:44:20.644589 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:40101
--webserver_interface=127.12.177.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:32945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:44:20.679509 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } attempt: 1
I20260806 18:44:20.680681 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.680260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45916)
0806 18:44:20.680489 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.680577 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 18:44:20.681646 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.681333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45920)
0806 18:44:20.681510 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.681571 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260806 18:44:20.681851 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:40101: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
I20260806 18:44:20.750134 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } attempt: 2
I20260806 18:44:20.751181 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.750762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45926)
0806 18:44:20.750995 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.751077 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 18:44:20.752099 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.751838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45932)
0806 18:44:20.751963 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.752024 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 18:44:20.752285 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:40101: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
W20260806 18:44:20.774199 14727 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:20.774565 14727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:20.774592 14727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:20.774634 14727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:20.778996 14727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:20.779085 14727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:20.779105 14727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:20.779124 14727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:20.779139 14727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:20.785864 14727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:32945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:40101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.177.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:20.787146 14727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:20.788272 14727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:20.798182 14741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:20.798167 14736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:20.798167 14737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:20.798244 14727 server_base.cc:1034] running on GCE node
I20260806 18:44:20.799206 14727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:20.800529 14727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:20.801751 14727 hybrid_clock.cc:648] HybridClock initialized: now 1786041860801747 us; error 58 us; skew 500 ppm
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:20.804762 14727 init.cc:377] Logged in from keytab as kudu/127.12.177.189@KRBTEST.COM (short username kudu)
I20260806 18:44:20.805757 14727 webserver.cc:460] Webserver started at http://127.12.177.189:32851/ using document root <none> and password file <none>
I20260806 18:44:20.806420 14727 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:20.806486 14727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:20.806663 14727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:20.808811 14727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data/instance:
uuid: "813f650ee3ba49bcbb573089ada8cb5f"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "af560b3d9e48211d0bd43d64a4545eed"
server_key_iv: "7aca6e8915829ec43825edbbdd936506"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.809451 14727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal/instance:
uuid: "813f650ee3ba49bcbb573089ada8cb5f"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "af560b3d9e48211d0bd43d64a4545eed"
server_key_iv: "7aca6e8915829ec43825edbbdd936506"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.813616 14727 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 18:44:20.816185 14751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:20.817554 14727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:20.817689 14727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "813f650ee3ba49bcbb573089ada8cb5f"
format_stamp: "Formatted at 2026-08-06 18:44:20 on dist-test-slave-j2vl"
server_key: "af560b3d9e48211d0bd43d64a4545eed"
server_key_iv: "7aca6e8915829ec43825edbbdd936506"
server_key_version: "encryptionkey@0"
I20260806 18:44:20.817812 14727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:20.843477 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } attempt: 3
I20260806 18:44:20.844481 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.844133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45934)
0806 18:44:20.844323 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.844393 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 18:44:20.844849 14727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:20.845417 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.845086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45940)
0806 18:44:20.845225 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.845289 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 18:44:20.845606 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:40101: Network error: Client connection negotiation failed: client connection to 127.12.177.189:40101: connect: Connection refused (error 111)
I20260806 18:44:20.848749 14727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:20.849022 14727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:20.857573 14727 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.189:40101
I20260806 18:44:20.857903 14833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.189:40101 every 8 connection(s)
I20260806 18:44:20.858768 14727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
I20260806 18:44:20.862250 14836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:20.864264 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14727
I20260806 18:44:20.864454 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-1/wal/instance
I20260806 18:44:20.864740 12998 external_mini_cluster.cc:1428] Setting key 857c2117b4620b3721fe174e8e7e74c7
I20260806 18:44:20.867058 14836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.177.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.188@KRBTEST.COM" created.
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:20.883843 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.869803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53600 (local address 127.12.177.190:38245)
0806 18:44:20.869992 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:20.869996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:20.871344 (+ 1348us) server_negotiation.cc:407] Connection header received
0806 18:44:20.872390 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:20.872394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:20.872455 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:20.872548 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:20.873887 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.874429 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.875757 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.876009 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.876126 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.879122 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:20.879126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:20.879128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:20.879157 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:20.880951 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.881643 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.881649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.881653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.881762 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.882204 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.882211 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.882216 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.882534 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:20.882649 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:20.883382 (+ 733us) server_negotiation.cc:299] Negotiation successful
0806 18:44:20.883590 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 18:44:20.884843 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.870372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:38245 (local address 127.0.0.1:53600)
0806 18:44:20.871169 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.871219 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:20.872169 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:20.872732 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:20.872739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:20.873111 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:20.873724 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.873739 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.874585 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.874588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.875601 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.875612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.876196 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.876200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.876385 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.877102 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:20.877120 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:20.878911 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:20.881108 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.881114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.881130 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.881532 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.881887 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.881889 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.881891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.882066 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.882680 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:20.882686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:20.883046 (+ 360us) client_negotiation.cc:769] Sending connection context
0806 18:44:20.883239 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 18:44:20.883593 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":224,"threads_started":1}
I20260806 18:44:20.886476 14836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
I20260806 18:44:20.897635 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.887144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45954)
0806 18:44:20.887267 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.887284 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:20.887380 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:20.888042 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:20.888046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:20.888258 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:20.888350 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.888355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.889455 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.889459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.890071 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.890082 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.890879 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.890882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.890977 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.891541 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:20.891556 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:20.893049 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:20.895783 (+ 2734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.895788 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.895791 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.895999 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.896325 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.896334 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.896337 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.896412 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.897024 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:20.897027 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:20.897124 (+ 97us) client_negotiation.cc:769] Sending connection context
0806 18:44:20.897237 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 18:44:20.897427 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 18:44:20.897656 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.887270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45954 (local address 127.12.177.189:40101)
0806 18:44:20.887671 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:20.887680 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:20.887699 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:44:20.887737 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:20.887741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:20.887914 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:20.888068 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:20.888467 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.889264 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.890213 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.890724 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.890871 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.893222 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:20.893278 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:20.893301 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:20.893332 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:20.895640 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.896135 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.896141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.896142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.896218 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.896515 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.896519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.896520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.896848 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:20.897019 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:20.897369 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 18:44:20.897516 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":193,"threads_started":1}
I20260806 18:44:20.898072 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:43905
--webserver_interface=127.12.177.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:32945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:44:20.902391 14836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:20.903520 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.903087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55672)
0806 18:44:20.903278 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.903400 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 18:44:20.903844 14757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
I20260806 18:44:20.905074 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.904726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55676)
0806 18:44:20.904892 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.904968 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 18:44:20.905301 14836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:43905: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
I20260806 18:44:20.954716 14836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } attempt: 1
I20260806 18:44:20.955767 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.955366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55692)
0806 18:44:20.955580 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.955664 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 18:44:20.956629 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.956379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55702)
0806 18:44:20.956506 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.956564 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 18:44:20.956835 14836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:43905: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
I20260806 18:44:20.988826 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } attempt: 4
Aug 06 18:44:20 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:44:20.999209 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.989572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45964)
0806 18:44:20.989835 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:20.989854 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:20.989997 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:20.990284 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:20.990287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:20.990507 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:20.990608 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.990614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.991441 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.991445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.991999 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:20.992008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.993037 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.993041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:20.993160 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.993830 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:20.993847 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:20.995562 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:20.997564 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.997568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.997570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.997806 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.998116 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:20.998119 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:20.998121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:20.998208 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:20.998625 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:20.998629 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:20.998741 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 18:44:20.998857 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 18:44:20.999025 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260806 18:44:20.999209 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:20.989684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45964 (local address 127.12.177.189:40101)
0806 18:44:20.989835 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:20.989840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:20.989933 (+ 93us) server_negotiation.cc:407] Connection header received
0806 18:44:20.990104 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:20.990112 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:20.990168 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:20.990261 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:20.990736 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.991316 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.992132 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:20.992890 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:20.993016 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:20.995731 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:20.995736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:20.995739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:20.995771 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:20.997426 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.997913 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.997917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.997919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.998012 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:20.998306 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:20.998309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:20.998311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:20.998523 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:20.998637 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:20.998913 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 18:44:20.999047 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 18:44:21.000169 14718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:21.001029 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.000737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55712)
0806 18:44:21.000879 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.000935 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 18:44:21.001973 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.001752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55716)
0806 18:44:21.001860 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.001909 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 18:44:21.002140 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:43905: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
I20260806 18:44:21.025015 14836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } attempt: 2
I20260806 18:44:21.025987 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.025636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55726)
0806 18:44:21.025813 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.025890 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 18:44:21.026841 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.026602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55732)
0806 18:44:21.026720 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.026775 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 18:44:21.027031 14836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:43905: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
W20260806 18:44:21.032830 14852 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:21.033330 14852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:21.033452 14852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:21.033530 14852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:21.037812 14852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:21.037907 14852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:21.037955 14852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:21.037994 14852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:21.038034 14852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:21.044023 14852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:32945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:38245,127.12.177.189:40101,127.12.177.188:43905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:43905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.177.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:21.045296 14852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:21.046435 14852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:21.056195 14865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:21.056185 14871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:21.056259 14852 server_base.cc:1034] running on GCE node
W20260806 18:44:21.056185 14862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:21.057173 14852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:21.058455 14852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:21.059638 14852 hybrid_clock.cc:648] HybridClock initialized: now 1786041861059624 us; error 28 us; skew 500 ppm
I20260806 18:44:21.061331 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } attempt: 1
I20260806 18:44:21.062232 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.061912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55748)
0806 18:44:21.062058 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.062125 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041861, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:21.063089 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.062842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55752)
0806 18:44:21.062964 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.063022 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 18:44:21.063099 14852 init.cc:377] Logged in from keytab as kudu/127.12.177.188@KRBTEST.COM (short username kudu)
W20260806 18:44:21.063230 14718 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:43905: Network error: Client connection negotiation failed: client connection to 127.12.177.188:43905: connect: Connection refused (error 111)
I20260806 18:44:21.064078 14852 webserver.cc:460] Webserver started at http://127.12.177.188:45537/ using document root <none> and password file <none>
I20260806 18:44:21.064635 14852 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:21.064695 14852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:21.064872 14852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:21.067091 14852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data/instance:
uuid: "d7db4d1550d44873811656bbe60c8a0f"
format_stamp: "Formatted at 2026-08-06 18:44:21 on dist-test-slave-j2vl"
server_key: "f18eb72bed14a5203b5f4e7f5e65fcb4"
server_key_iv: "27d342d3cf9d2eb4bdded96689cf1caf"
server_key_version: "encryptionkey@0"
I20260806 18:44:21.067713 14852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal/instance:
uuid: "d7db4d1550d44873811656bbe60c8a0f"
format_stamp: "Formatted at 2026-08-06 18:44:21 on dist-test-slave-j2vl"
server_key: "f18eb72bed14a5203b5f4e7f5e65fcb4"
server_key_iv: "27d342d3cf9d2eb4bdded96689cf1caf"
server_key_version: "encryptionkey@0"
I20260806 18:44:21.072111 14852 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 18:44:21.075181 14881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:21.076680 14852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:44:21.076854 14852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "d7db4d1550d44873811656bbe60c8a0f"
format_stamp: "Formatted at 2026-08-06 18:44:21 on dist-test-slave-j2vl"
server_key: "f18eb72bed14a5203b5f4e7f5e65fcb4"
server_key_iv: "27d342d3cf9d2eb4bdded96689cf1caf"
server_key_version: "encryptionkey@0"
I20260806 18:44:21.076990 14852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:21.094856 14852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:21.098109 14852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:21.098336 14852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:21.106565 14852 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.188:43905
I20260806 18:44:21.106943 14958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.188:43905 every 8 connection(s)
I20260806 18:44:21.107753 14852 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
I20260806 18:44:21.108678 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 14852
I20260806 18:44:21.108809 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786041540454168-12998-0/minicluster-data/master-2/wal/instance
I20260806 18:44:21.109119 12998 external_mini_cluster.cc:1428] Setting key dba49d01c73e8f0a11756455744fd69e
I20260806 18:44:21.111339 14959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:21.115921 14959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:21.118263 14836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } attempt: 3
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041861, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:21.126981 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.110591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55754 (local address 127.12.177.188:43905)
0806 18:44:21.111027 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.111047 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.111085 (+ 38us) server_negotiation.cc:407] Connection header received
0806 18:44:21.111811 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.111828 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.112156 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.112438 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.113480 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.114531 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.115706 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.116259 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.116437 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.119763 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.119770 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.119782 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.119815 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.121898 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.122444 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.122452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.122459 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.122616 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.122969 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.122974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.122976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.124143 (+ 1167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.124363 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.125322 (+ 959us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.125722 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"spinlock_wait_cycles":3840,"thread_start_us":153,"threads_started":1}
I20260806 18:44:21.128940 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.117933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:38245 (local address 127.0.0.1:53606)
0806 18:44:21.118405 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.118461 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:21.118650 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:21.119153 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:21.119160 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:21.119663 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:21.119835 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.119841 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.121058 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.121062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.122077 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.122089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.122782 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.122786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.122915 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.123332 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:21.123344 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:21.125281 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:21.127056 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.127066 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.127072 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.127383 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.127692 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.127696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.127698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.127791 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.128214 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:21.128222 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:21.128372 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 18:44:21.128571 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 18:44:21.128762 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"spinlock_wait_cycles":7936,"thread_start_us":133,"threads_started":1}
I20260806 18:44:21.129014 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.117965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.12.177.190:38245)
0806 18:44:21.118124 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.118129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.118543 (+ 414us) server_negotiation.cc:407] Connection header received
0806 18:44:21.118794 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.118800 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.118861 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.118948 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.119968 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.120671 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.122206 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.122544 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.122646 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.125486 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.125490 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.125492 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.125525 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.126924 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.127500 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.127504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.127506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.127595 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.127888 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.127892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.127894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.128089 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.128196 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.128690 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.128839 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 18:44:21.130401 14718 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } attempt: 2
I20260806 18:44:21.130409 14959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:21.130616 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.118759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55768)
0806 18:44:21.118960 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.118974 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:21.119062 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:21.119483 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:21.119486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:21.119718 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:21.119833 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.119842 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.120919 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.120924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.121837 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.121849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.122514 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.122520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.122611 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.123076 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:21.123091 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:21.124474 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:21.128807 (+ 4333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.128811 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.128814 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.129082 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.129457 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.129461 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.129463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.129571 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.130054 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:21.130058 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:21.130175 (+ 117us) client_negotiation.cc:769] Sending connection context
0806 18:44:21.130287 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 18:44:21.130454 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 18:44:21.131158 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.118970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.12.177.188:43905)
0806 18:44:21.119272 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.119278 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.119289 (+ 11us) server_negotiation.cc:407] Connection header received
0806 18:44:21.119315 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.119317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.119349 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.119454 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.119981 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.120793 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.121966 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.122397 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.122489 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.124617 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.124620 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.124622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.124642 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.128647 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.129232 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.129235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.129236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.129331 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.129692 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.129695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.129696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.129915 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.130057 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.130834 (+ 777us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.130974 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":134,"threads_started":1}
I20260806 18:44:21.134888 14836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: Bootstrap starting.
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041861, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
I20260806 18:44:21.138387 14836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:21.139474 14836 log.cc:824] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: Log is configured to *not* fsync() on all Append() calls
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:21.141588 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.130814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55770)
0806 18:44:21.131116 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.131130 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:21.131214 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:21.132152 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:21.132155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:21.132327 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:21.132406 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.132411 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.133227 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.133230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.134069 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.134077 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.134671 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.134675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.134792 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.135393 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:21.135409 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:21.137325 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:21.139474 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.139477 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.139479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.139749 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.140089 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.140095 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.140101 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.140199 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.140705 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:21.140708 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:21.140821 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 18:44:21.140914 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 18:44:21.141416 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260806 18:44:21.141836 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.131747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55770 (local address 127.12.177.188:43905)
0806 18:44:21.131964 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.131968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.131978 (+ 10us) server_negotiation.cc:407] Connection header received
0806 18:44:21.132011 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.132012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.132044 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.132129 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.132521 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.133109 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.134201 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.134553 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.135012 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.137522 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.137526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.137529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.137556 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.139337 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.139880 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.139884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.139887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.139977 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.140339 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.140342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.140344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.140589 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.141157 (+ 568us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.141237 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.141487 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":149}
I20260806 18:44:21.142066 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.130872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:40101 (local address 127.0.0.1:45974)
0806 18:44:21.131035 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.131048 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:21.131119 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:21.131442 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:21.131447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:21.131618 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:21.131750 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.131758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.133039 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.133042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.133898 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.133910 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.134575 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.134579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.134682 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.135194 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:21.135208 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:21.137406 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:21.139673 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.139676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.139678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.139943 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.140294 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.140296 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.140298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.140368 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.141239 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:21.141243 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:21.141585 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 18:44:21.141721 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 18:44:21.141886 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":36}
I20260806 18:44:21.142750 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.131094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.12.177.189:40101)
0806 18:44:21.131212 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.131216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.131228 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:44:21.131266 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.131268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.131314 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.131397 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.131896 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.132625 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.134038 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.134344 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.134421 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.137571 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.137574 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.137577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.137603 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.139535 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.140070 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.140075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.140080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.140173 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.140514 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.140518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.140520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.141100 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.141199 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.142455 (+ 1256us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.142602 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 18:44:21.142882 14836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: No bootstrap required, opened a new log
I20260806 18:44:21.145143 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.130774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.12.177.190:38245)
0806 18:44:21.131806 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.131812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.132902 (+ 1090us) server_negotiation.cc:407] Connection header received
0806 18:44:21.132999 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.133002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.133041 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.133113 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.134014 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.134727 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.136309 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.136529 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.136635 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.140504 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.140510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.140513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.140539 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.143044 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.143575 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.143578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.143580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.143821 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.144170 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.144173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.144175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.144409 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.144635 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.144829 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.144980 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181}
I20260806 18:44:21.145442 14718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: Bootstrap starting.
I20260806 18:44:21.147578 14836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.147852 14836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813f650ee3ba49bcbb573089ada8cb5f, State: Initialized, Role: FOLLOWER
I20260806 18:44:21.148203 14718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:21.148204 14836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.149132 14718 log.cc:824] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:21.149587 14836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:21.150023 14959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
Aug 06 18:44:21 dist-test-slave-j2vl krb5kdc[14605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041861, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
W20260806 18:44:21.156020 14994 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:21.156150 14994 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:21.153937 14727 master_runner.cc:186] Error getting master registration for 127.12.177.190:38245: OK, instance_id { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" instance_seqno: 1786041860595090 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 18:44:21.158140 14727 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:21.157907 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.146607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.12.177.189:40101)
0806 18:44:21.146719 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.146723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.146737 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:44:21.146779 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.146783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.146835 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.146919 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.147687 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.148443 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.149546 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.149877 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.149952 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.153370 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.153375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.153378 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.153405 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.155526 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.156065 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.156069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.156072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.156161 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.156758 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.156761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.156763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.157006 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.157173 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.157609 (+ 436us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.157747 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 18:44:21.159024 14973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.159305 14973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.159673 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.150715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:43905 (local address 127.0.0.1:55786)
0806 18:44:21.151009 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:21.151024 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:21.151111 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:21.151342 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:21.151345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:21.151555 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:21.151650 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.151658 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.152531 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.152535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.153249 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:21.153261 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.153848 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.153851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:21.153922 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.154362 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:21.154375 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:21.156064 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:21.158165 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.158170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.158175 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.158427 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.158680 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:21.158683 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:21.158685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:21.158760 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:21.159213 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:21.159216 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:21.159295 (+ 79us) client_negotiation.cc:769] Sending connection context
0806 18:44:21.159370 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 18:44:21.159504 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260806 18:44:21.160532 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.150982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55786 (local address 127.12.177.188:43905)
0806 18:44:21.151079 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.151083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.151096 (+ 13us) server_negotiation.cc:407] Connection header received
0806 18:44:21.151195 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.151198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.151241 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.151330 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.151787 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.152417 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.153421 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.153720 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.154126 (+ 406us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.156206 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.156210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.156212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.156234 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.158022 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.158530 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.158533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.158534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.158603 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.158885 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.158888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.158891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.159099 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.160205 (+ 1106us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.160279 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.160394 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 18:44:21.164062 14959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: Bootstrap starting.
I20260806 18:44:21.167410 14959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:21.167985 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:21.168462 14959 log.cc:824] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:21.169819 14718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: No bootstrap required, opened a new log
I20260806 18:44:21.171164 14959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: No bootstrap required, opened a new log
I20260806 18:44:21.170734 14686 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53614
I20260806 18:44:21.174523 14718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.174846 14718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787a8635f6674c3cbb7b4a212f7c8bc0, State: Initialized, Role: FOLLOWER
I20260806 18:44:21.175154 14959 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.175282 14718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.175419 14959 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7db4d1550d44873811656bbe60c8a0f, State: Initialized, Role: FOLLOWER
I20260806 18:44:21.175787 14959 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.176083 15000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.176415 15000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.176910 14718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:21.176994 14686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 18:44:21.177032 14959 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:21.177111 14686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:21.178588 14686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.181277 14798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "813f650ee3ba49bcbb573089ada8cb5f"
I20260806 18:44:21.181668 14798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:21.183337 14798 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787a8635f6674c3cbb7b4a212f7c8bc0 in term 1.
W20260806 18:44:21.183655 15040 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:21.186074 15040 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:21.186807 14649 leader_election.cc:302] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787a8635f6674c3cbb7b4a212f7c8bc0, 813f650ee3ba49bcbb573089ada8cb5f; no voters:
I20260806 18:44:21.183866 14919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d7db4d1550d44873811656bbe60c8a0f"
I20260806 18:44:21.187341 14919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:21.188966 14919 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787a8635f6674c3cbb7b4a212f7c8bc0 in term 1.
I20260806 18:44:21.193668 15002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.193841 15002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.198004 14852 master_runner.cc:263] No leader master found from master d7db4d1550d44873811656bbe60c8a0f
I20260806 18:44:21.198098 14852 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:21.201267 14622 master_runner.cc:263] No leader master found from master 787a8635f6674c3cbb7b4a212f7c8bc0
I20260806 18:44:21.201413 14622 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:21.179710 14686 leader_election.cc:288] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [CANDIDATE]: Term 1 election: Requested vote from peers 813f650ee3ba49bcbb573089ada8cb5f (127.12.177.189:40101), d7db4d1550d44873811656bbe60c8a0f (127.12.177.188:43905)
W20260806 18:44:21.183540 15038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:21.201718 15038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:21.204109 15000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:21.204466 15000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [term 1 LEADER]: Becoming Leader. State: Replica: 787a8635f6674c3cbb7b4a212f7c8bc0, State: Running, Role: LEADER
I20260806 18:44:21.204944 15000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } }
I20260806 18:44:21.207392 15000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 787a8635f6674c3cbb7b4a212f7c8bc0. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.207610 15000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:21.211403 15049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:21.212481 15049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:21.225915 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.213897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.12.177.190:38245)
0806 18:44:21.214034 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.214038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.215554 (+ 1516us) server_negotiation.cc:407] Connection header received
0806 18:44:21.215767 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.215771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.215840 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.215896 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.217037 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.217893 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.219137 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.219476 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.219552 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.221906 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.221910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.221913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.221942 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.223874 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.224376 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.224380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.224382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.224477 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.224796 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.224800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.224802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.225025 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.225126 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.225542 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.225694 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 18:44:21.237792 14919 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [term 1 FOLLOWER]: Refusing update from remote peer 787a8635f6674c3cbb7b4a212f7c8bc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:44:21.237799 14798 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [term 1 FOLLOWER]: Refusing update from remote peer 787a8635f6674c3cbb7b4a212f7c8bc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:44:21.238634 15000 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:44:21.239154 15000 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:44:21.240427 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.214910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45994 (local address 127.12.177.189:40101)
0806 18:44:21.215083 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.215088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.224188 (+ 9100us) server_negotiation.cc:407] Connection header received
0806 18:44:21.225424 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.225431 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.225499 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.225555 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.229580 (+ 4025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.230406 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.231625 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.232010 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.232099 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.235051 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.235056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.235059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.235098 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.236934 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.237520 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.237524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.237526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.237619 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.239175 (+ 1556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.239181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.239184 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.239522 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.239660 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.240089 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.240239 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:44:21.244583 15002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 787a8635f6674c3cbb7b4a212f7c8bc0. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.244583 14973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 787a8635f6674c3cbb7b4a212f7c8bc0. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.244755 15002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.244755 14973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.247855 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:21.214412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55794 (local address 127.12.177.188:43905)
0806 18:44:21.214535 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.214539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.221675 (+ 7136us) server_negotiation.cc:407] Connection header received
0806 18:44:21.221888 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.221892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.221953 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.222015 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.222962 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.223817 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.226476 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:21.226834 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:21.226917 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:21.238012 (+ 11095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:21.238016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:21.238020 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:21.238052 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:21.239900 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.246308 (+ 6408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.246313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.246315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.246433 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:21.246750 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:21.246754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:21.246756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:21.247010 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:21.247130 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:21.247507 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 18:44:21.247664 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 18:44:21.257189 15056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.257843 15056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:21.258702 14973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.258858 14973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.259554 15060 mvcc.cc:205] Tried to move back new op lower bound from 7315627463618768896 to 7315627463500374016. Current Snapshot: MvccSnapshot[applied={T|T < 7315627463618768896}]
I20260806 18:44:21.261827 15056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.261993 15056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:21.263690 15002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "787a8635f6674c3cbb7b4a212f7c8bc0" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 38245 } } peers { permanent_uuid: "813f650ee3ba49bcbb573089ada8cb5f" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 40101 } } peers { permanent_uuid: "d7db4d1550d44873811656bbe60c8a0f" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 43905 } } }
I20260806 18:44:21.263839 15002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:21.266525 15049 catalog_manager.cc:1347] Generated new cluster ID: 029770c3d784493fba8a8b1e0a113607
I20260806 18:44:21.266611 15049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:21.323487 15049 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:21.324971 15049 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:21.355476 15049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 787a8635f6674c3cbb7b4a212f7c8bc0: Generated new TSK 0
I20260806 18:44:21.356613 15049 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:44:21.399037 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.395610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46006 (local address 127.12.177.189:40101)
0806 18:44:21.395741 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.395745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.397815 (+ 2070us) server_negotiation.cc:407] Connection header received
0806 18:44:21.398039 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.398042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.398100 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.398155 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.398878 (+ 723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46006: BlockingRecv error: recv got EOF from 127.0.0.1:46006 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 18:44:21.400871 14966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.396470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55798 (local address 127.12.177.188:43905)
0806 18:44:21.396596 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.396601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.399774 (+ 3173us) server_negotiation.cc:407] Connection header received
0806 18:44:21.399893 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.399898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.399966 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.400051 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.400694 (+ 643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55798: BlockingRecv error: recv got EOF from 127.0.0.1:55798 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 18:44:21.402498 14721 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.397131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.12.177.190:38245)
0806 18:44:21.397250 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.397254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.400143 (+ 2889us) server_negotiation.cc:407] Connection header received
0806 18:44:21.401658 (+ 1515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.401662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.401721 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.401774 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.402366 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53628: BlockingRecv error: recv got EOF from 127.0.0.1:53628 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 18:44:21.407758 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.405910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.12.177.189:40101)
0806 18:44:21.406030 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.406035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.406579 (+ 544us) server_negotiation.cc:407] Connection header received
0806 18:44:21.406846 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.406851 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.406953 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.407015 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.407635 (+ 620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46020: BlockingRecv error: recv got EOF from 127.0.0.1:46020 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 18:44:21.414225 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.412087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46026 (local address 127.12.177.189:40101)
0806 18:44:21.412224 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.412230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.412956 (+ 726us) server_negotiation.cc:407] Connection header received
0806 18:44:21.413187 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.413191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.413267 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.413326 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.414062 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46026: BlockingRecv error: recv got EOF from 127.0.0.1:46026 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 18:44:21.420611 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.418826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46036 (local address 127.12.177.189:40101)
0806 18:44:21.418957 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.418961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.419556 (+ 595us) server_negotiation.cc:407] Connection header received
0806 18:44:21.419761 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.419764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.419822 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.419878 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.420487 (+ 609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46036: BlockingRecv error: recv got EOF from 127.0.0.1:46036 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 18:44:21.428560 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.427236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.12.177.189:40101)
0806 18:44:21.427453 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.427458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.427578 (+ 120us) server_negotiation.cc:407] Connection header received
0806 18:44:21.427730 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.427769 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.427822 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.427925 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.428449 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46040: BlockingRecv error: recv got EOF from 127.0.0.1:46040 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
W20260806 18:44:21.440703 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.439351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46050 (local address 127.12.177.189:40101)
0806 18:44:21.439543 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.439549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.439619 (+ 70us) server_negotiation.cc:407] Connection header received
0806 18:44:21.439824 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.439826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.439910 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.440010 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.440581 (+ 571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46050: BlockingRecv error: recv got EOF from 127.0.0.1:46050 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 18:44:21.460824 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.459368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46058 (local address 127.12.177.189:40101)
0806 18:44:21.459581 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.459586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.459727 (+ 141us) server_negotiation.cc:407] Connection header received
0806 18:44:21.459944 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.459969 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.460026 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.460128 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.460698 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46058: BlockingRecv error: recv got EOF from 127.0.0.1:46058 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260806 18:44:21.497140 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.495655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46070 (local address 127.12.177.189:40101)
0806 18:44:21.495856 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.495861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.496087 (+ 226us) server_negotiation.cc:407] Connection header received
0806 18:44:21.496302 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.496305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.496358 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.496455 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.497016 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46070: BlockingRecv error: recv got EOF from 127.0.0.1:46070 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 18:44:21.565315 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.563898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46072 (local address 127.12.177.189:40101)
0806 18:44:21.564103 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.564108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.564273 (+ 165us) server_negotiation.cc:407] Connection header received
0806 18:44:21.564482 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.564486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.564548 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.564648 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.565174 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46072: BlockingRecv error: recv got EOF from 127.0.0.1:46072 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260806 18:44:21.697530 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.696291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46088 (local address 127.12.177.189:40101)
0806 18:44:21.696492 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.696496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.696516 (+ 20us) server_negotiation.cc:407] Connection header received
0806 18:44:21.696649 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.696652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.696705 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.696784 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.697335 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46088: BlockingRecv error: recv got EOF from 127.0.0.1:46088 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260806 18:44:21.957327 14848 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:21.956201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46104 (local address 127.12.177.189:40101)
0806 18:44:21.956384 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:21.956389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:21.956407 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:44:21.956502 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:21.956506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:21.956564 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:21.956661 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:21.957173 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46104: BlockingRecv error: recv got EOF from 127.0.0.1:46104 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 18:44:22.157879 14994 catalog_manager.cc:1259] Loaded cluster ID: 029770c3d784493fba8a8b1e0a113607
I20260806 18:44:22.157995 14994 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: loading cluster ID for follower catalog manager: success
I20260806 18:44:22.160032 14994 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: acquiring CA information for follower catalog manager: success
I20260806 18:44:22.161531 14994 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 813f650ee3ba49bcbb573089ada8cb5f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:44:22.187501 15040 catalog_manager.cc:1259] Loaded cluster ID: 029770c3d784493fba8a8b1e0a113607
I20260806 18:44:22.187605 15040 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: loading cluster ID for follower catalog manager: success
I20260806 18:44:22.189507 15040 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: acquiring CA information for follower catalog manager: success
I20260806 18:44:22.190900 15040 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d7db4d1550d44873811656bbe60c8a0f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:44:22.476012 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:22.471834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.12.177.189:40101)
0806 18:44:22.472108 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:22.472115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:22.472133 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:44:22.472299 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:22.472303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:22.472458 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:22.472581 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:22.472854 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.473483 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.474367 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.474608 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.474735 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:22.475091 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:22.475581 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:22.475730 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:22.475768 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 18:44:22.475832 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
I20260806 18:44:22.484081 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:22.479752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.12.177.188:43905)
0806 18:44:22.480000 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:22.480004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:22.480020 (+ 16us) server_negotiation.cc:407] Connection header received
0806 18:44:22.480109 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:22.480111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:22.480237 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:22.480346 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:22.480728 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.481493 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.482482 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.482721 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.482802 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:22.483135 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:22.483621 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:22.483720 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:22.483772 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 18:44:22.483830 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260806 18:44:22.491983 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:22.487925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55828 (local address 127.12.177.188:43905)
0806 18:44:22.488064 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:22.488070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:22.488087 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:44:22.488278 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:22.488283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:22.488334 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:22.488426 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:22.488693 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.489422 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.490598 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.490920 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.490983 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:22.491402 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:22.491500 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:22.491548 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:22.491740 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 18:44:22.491813 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 18:44:22.492126 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:22.487513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46120 (local address 127.12.177.189:40101)
0806 18:44:22.487661 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:22.487668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:22.488130 (+ 462us) server_negotiation.cc:407] Connection header received
0806 18:44:22.488265 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:22.488269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:22.488339 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:22.488417 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:22.488808 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.489718 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.490810 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.491174 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.491300 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:22.491573 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:22.491654 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:22.491742 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:22.491923 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 18:44:22.491991 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 18:44:22.493028 15187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:22.487512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53634 (local address 127.12.177.190:38245)
0806 18:44:22.487837 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:22.487845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:22.488484 (+ 639us) server_negotiation.cc:407] Connection header received
0806 18:44:22.488771 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:22.488777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:22.488971 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:22.489125 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:22.489435 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.490119 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.491114 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:22.491469 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:22.491581 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:22.492014 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:22.492443 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:22.492516 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:22.492807 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 18:44:22.492883 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":72,"threads_started":1}
I20260806 18:44:22.502213 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14622
I20260806 18:44:22.515882 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14727
I20260806 18:44:22.527908 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 14852
2026-08-06T18:44:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3578 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 18:44:22 dist-test-slave-j2vl krb5kdc[15192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 18:44:22 dist-test-slave-j2vl krb5kdc[15192](info): set up 2 sockets
Aug 06 18:44:22 dist-test-slave-j2vl krb5kdc[15192](info): commencing operation
krb5kdc: starting...
W20260806 18:44:23.810621 12998 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/test-user.keytab.
Aug 06 18:44:23 dist-test-slave-j2vl krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T18:44:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T18:44:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.177.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
Entry for principal kudu/127.12.177.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab.
I20260806 18:44:23.973857 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37085
--webserver_interface=127.12.177.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 18:44:24.094355 15213 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:24.094769 15213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:24.094836 15213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:24.094923 15213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:24.099223 15213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:24.099334 15213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:24.099371 15213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:24.099412 15213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:24.099453 15213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:24.105235 15213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.190.keytab
--principal=kudu/127.12.177.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.190:37085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.177.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:24.106590 15213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:24.107790 15213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:24.117707 15225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:24.117707 15236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.117790 15213 server_base.cc:1034] running on GCE node
W20260806 18:44:24.117712 15232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.118762 15213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:24.120110 15213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:24.121363 15213 hybrid_clock.cc:648] HybridClock initialized: now 1786041864121329 us; error 33 us; skew 500 ppm
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:24.124431 15213 init.cc:377] Logged in from keytab as kudu/127.12.177.190@KRBTEST.COM (short username kudu)
I20260806 18:44:24.125540 15213 webserver.cc:460] Webserver started at http://127.12.177.190:44509/ using document root <none> and password file <none>
I20260806 18:44:24.126160 15213 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:24.126260 15213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:24.126515 15213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:24.128751 15213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data/instance:
uuid: "89838127cb3540a3b65b358a14f2aa15"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "6af997593b1991184cd6e24e8f54da96"
server_key_iv: "e9f921cc69cc7a4f7a3789d1f5d6ce26"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.129448 15213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance:
uuid: "89838127cb3540a3b65b358a14f2aa15"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "6af997593b1991184cd6e24e8f54da96"
server_key_iv: "e9f921cc69cc7a4f7a3789d1f5d6ce26"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.133762 15213 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 18:44:24.136559 15245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:24.138002 15213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:24.138182 15213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal
uuid: "89838127cb3540a3b65b358a14f2aa15"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "6af997593b1991184cd6e24e8f54da96"
server_key_iv: "e9f921cc69cc7a4f7a3789d1f5d6ce26"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.138321 15213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:24.169836 15213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:24.173887 15213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:24.174135 15213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:24.182231 15213 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.190:37085
I20260806 18:44:24.182492 15325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.190:37085 every 8 connection(s)
I20260806 18:44:24.183456 15213 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/data/info.pb
I20260806 18:44:24.186522 15326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:24.190783 15326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.192798 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15213
I20260806 18:44:24.192950 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-0/wal/instance
I20260806 18:44:24.193286 12998 external_mini_cluster.cc:1428] Setting key 40d3bd731133bb3266fcc864a57ef0bc
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.177.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.189@KRBTEST.COM" created.
I20260806 18:44:24.207893 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.193674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37085 (local address 127.0.0.1:56872)
0806 18:44:24.194518 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.194569 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.195628 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.196404 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.196409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.196894 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.197155 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.197170 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.198415 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.198419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.199264 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.199274 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.199974 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.199977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.200093 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.200736 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.200754 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.202358 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.204548 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.204558 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.204567 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.204814 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.205272 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.205276 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.205277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.205483 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.206331 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.206337 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.206481 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.206628 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.206966 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":351,"threads_started":1}
I20260806 18:44:24.207897 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.194995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.12.177.190:37085)
0806 18:44:24.195343 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.195357 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.195408 (+ 51us) server_negotiation.cc:407] Connection header received
0806 18:44:24.195962 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.195967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.196199 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.196404 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.197315 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.198282 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.199410 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.199809 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.199986 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.202572 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.202582 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.202597 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.202632 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.204429 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.205018 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.205023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.205025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.205145 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.205623 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.205626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.205627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.206170 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.206356 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.206776 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.207113 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":239,"thread_start_us":117,"threads_started":1}
I20260806 18:44:24.210855 15326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.211791 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.211401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58726)
0806 18:44:24.211581 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.211682 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 18:44:24.211990 15248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
I20260806 18:44:24.212998 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.212696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58742)
0806 18:44:24.212844 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.212911 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 18:44:24.213188 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:38065: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
Entry for principal kudu/127.12.177.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab.
I20260806 18:44:24.225287 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:38065
--webserver_interface=127.12.177.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:44:24.262507 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } attempt: 1
I20260806 18:44:24.263610 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.263196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58756)
0806 18:44:24.263415 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.263498 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 18:44:24.264551 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.264271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58770)
0806 18:44:24.264413 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.264474 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 18:44:24.264699 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:38065: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
I20260806 18:44:24.332890 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } attempt: 2
I20260806 18:44:24.333863 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.333514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58784)
0806 18:44:24.333711 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.333780 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 18:44:24.334764 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.334534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58796)
0806 18:44:24.334644 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.334695 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 18:44:24.334941 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.189:38065: Network error: Client connection negotiation failed: client connection to 127.12.177.189:38065: connect: Connection refused (error 111)
W20260806 18:44:24.354306 15336 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:24.354624 15336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:24.354648 15336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:24.354691 15336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:24.358841 15336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:24.358912 15336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:24.358932 15336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:24.358950 15336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:24.358966 15336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:24.364679 15336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.189.keytab
--principal=kudu/127.12.177.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.189:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.177.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:24.365949 15336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:24.367019 15336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:24.376935 15345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:24.376926 15344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.377024 15336 server_base.cc:1034] running on GCE node
W20260806 18:44:24.376926 15350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.377902 15336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:24.379136 15336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:24.380328 15336 hybrid_clock.cc:648] HybridClock initialized: now 1786041864380306 us; error 39 us; skew 500 ppm
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:24.383671 15336 init.cc:377] Logged in from keytab as kudu/127.12.177.189@KRBTEST.COM (short username kudu)
I20260806 18:44:24.384728 15336 webserver.cc:460] Webserver started at http://127.12.177.189:46399/ using document root <none> and password file <none>
I20260806 18:44:24.385411 15336 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:24.385520 15336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:24.385759 15336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:24.388197 15336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data/instance:
uuid: "e814187a8c484646af915053099294fe"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "478262a444331fe6e8082ef04abcbf6b"
server_key_iv: "97b73493472d8e1efd4b8a888d29136d"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.388898 15336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal/instance:
uuid: "e814187a8c484646af915053099294fe"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "478262a444331fe6e8082ef04abcbf6b"
server_key_iv: "97b73493472d8e1efd4b8a888d29136d"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.393492 15336 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 18:44:24.396522 15361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:24.398291 15336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 18:44:24.398483 15336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal
uuid: "e814187a8c484646af915053099294fe"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "478262a444331fe6e8082ef04abcbf6b"
server_key_iv: "97b73493472d8e1efd4b8a888d29136d"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.398630 15336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:24.413652 15336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:24.417697 15336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:24.417940 15336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:24.425953 15336 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.189:38065
I20260806 18:44:24.426111 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } attempt: 3
I20260806 18:44:24.426342 15447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.189:38065 every 8 connection(s)
I20260806 18:44:24.427316 15336 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/data/info.pb
I20260806 18:44:24.430585 15448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 18:44:24.434428 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15336
I20260806 18:44:24.434597 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-1/wal/instance
I20260806 18:44:24.434916 12998 external_mini_cluster.cc:1428] Setting key 6da8488e6e1935ccc22204da60969541
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:44:24.435863 15448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.440653 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.426733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58806)
0806 18:44:24.426928 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.426946 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.427058 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.429624 (+ 2566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.429628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.429859 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.430023 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.430033 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.431513 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.431518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.432358 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.432373 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.433193 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.433198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.433306 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.433888 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.433906 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.435550 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.438415 (+ 2865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.438421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.438425 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.438719 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.439116 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.439122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.439124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.439217 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.439951 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.439958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.440088 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.440209 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.440387 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 18:44:24.441747 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.427512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.12.177.189:38065)
0806 18:44:24.428071 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.428094 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.428134 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:24.428847 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.428863 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.429233 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.429624 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.430190 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.431354 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.432525 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.433044 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.433176 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.435809 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.435818 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.435842 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.435888 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.438250 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.438843 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.438848 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.438854 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.439017 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.439321 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.439324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.439326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.439826 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.439963 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.440378 (+ 415us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.440695 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":388,"thread_start_us":162,"threads_started":1}
I20260806 18:44:24.444260 15326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:24.445665 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.444822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33622)
0806 18:44:24.445532 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.445590 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":608}
WARNING: no policy specified for kudu/127.12.177.188@KRBTEST.COM; defaulting to no policy
I20260806 18:44:24.446520 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.446176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33628)
0806 18:44:24.446367 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.446434 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260806 18:44:24.446751 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.449891 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.437948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56884 (local address 127.12.177.190:37085)
0806 18:44:24.438102 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.438107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.438494 (+ 387us) server_negotiation.cc:407] Connection header received
0806 18:44:24.438677 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.438682 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.438738 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.438838 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.439832 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.440561 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.442054 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.443058 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.443144 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.446153 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.446157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.446161 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.446186 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.447773 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.448304 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.448307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.448308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.448391 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.448774 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.448777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.448779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.448980 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.449068 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.449582 (+ 514us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.449716 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 18:44:24.449936 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.437855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37085 (local address 127.0.0.1:56884)
0806 18:44:24.438365 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.438417 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.438584 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.438916 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.438924 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.439435 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.439694 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.439706 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.440976 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.440979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.441909 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.441923 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.443328 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.443330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.443421 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.444034 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.444055 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.445967 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.447904 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.447919 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.447926 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.448189 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.448482 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.448484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.448485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.448620 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.449104 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.449111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.449235 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.449492 (+ 257us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.449718 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":27,"thread_start_us":151,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.177.188@KRBTEST.COM" created.
I20260806 18:44:24.452368 15448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:44:24.462405 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.453007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58810)
0806 18:44:24.453292 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.453303 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.453420 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.453670 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.453672 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.453844 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.453957 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.453962 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.455028 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.455030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.455545 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.455553 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.456210 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.456212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.456347 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.456939 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.456952 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.458354 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.460420 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.460423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.460425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.460630 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.461012 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.461015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.461016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.461114 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.461680 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.461685 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.461844 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.461982 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.462165 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":33}
I20260806 18:44:24.462689 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.453170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.12.177.189:38065)
0806 18:44:24.453419 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.453426 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.453445 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:44:24.453496 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.453499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.453552 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.453648 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.454069 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.454914 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.455664 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.456085 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.456241 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.458511 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.458515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.458518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.458548 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.460289 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.460745 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.460751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.460753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.460855 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.461221 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.461231 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.461233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.461547 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.461665 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.462135 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.462320 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":87}
I20260806 18:44:24.463649 15448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.464728 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.464301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33632)
0806 18:44:24.464522 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.464629 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260806 18:44:24.465621 15363 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.467417 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.466876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33646)
0806 18:44:24.467251 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.467322 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283}
W20260806 18:44:24.467615 15448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
Entry for principal kudu/127.12.177.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab.
I20260806 18:44:24.474730 12998 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9NHeiD/build/debug/bin/kudu
/tmp/dist-test-task9NHeiD/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:33935
--webserver_interface=127.12.177.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.177.148:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 18:44:24.477926 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 1
I20260806 18:44:24.478873 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.478562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33656)
0806 18:44:24.478729 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.478793 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 18:44:24.479668 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.479445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33666)
0806 18:44:24.479558 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.479614 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 18:44:24.479822 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.516981 15448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 1
I20260806 18:44:24.518127 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.517777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33680)
0806 18:44:24.517969 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.518041 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 18:44:24.519068 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.518787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33692)
0806 18:44:24.518948 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.519008 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260806 18:44:24.519220 15448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.555006 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 2
I20260806 18:44:24.556013 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.555667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33706)
0806 18:44:24.555846 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.555914 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 18:44:24.556838 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.556601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33708)
0806 18:44:24.556716 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.556773 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 18:44:24.556980 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.587423 15448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 2
I20260806 18:44:24.588510 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.588098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33722)
0806 18:44:24.588283 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.588396 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 18:44:24.589335 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.589073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33724)
0806 18:44:24.589209 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.589265 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 18:44:24.589519 15448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
W20260806 18:44:24.600416 15459 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 18:44:24.600837 15459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 18:44:24.600904 15459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 18:44:24.600989 15459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 18:44:24.605312 15459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 18:44:24.605474 15459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 18:44:24.605516 15459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 18:44:24.605556 15459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 18:44:24.605589 15459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 18:44:24.611430 15459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.177.148:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.177.190:37085,127.12.177.189:38065,127.12.177.188:33935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/krb5kdc/kudu_127.12.177.188.keytab
--principal=kudu/127.12.177.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.177.188:33935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.177.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 17:59:13 UTC on ccycloud.quasar-wvsnzx.root.comops.site
build id 4571028
I20260806 18:44:24.613155 15459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 18:44:24.614352 15459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 18:44:24.624099 15466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 18:44:24.624094 15469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.624217 15459 server_base.cc:1034] running on GCE node
W20260806 18:44:24.624076 15471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 18:44:24.625090 15459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 18:44:24.626410 15459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 18:44:24.627611 15459 hybrid_clock.cc:648] HybridClock initialized: now 1786041864627580 us; error 42 us; skew 500 ppm
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 18:44:24.630954 15459 init.cc:377] Logged in from keytab as kudu/127.12.177.188@KRBTEST.COM (short username kudu)
I20260806 18:44:24.632093 15459 webserver.cc:460] Webserver started at http://127.12.177.188:38407/ using document root <none> and password file <none>
I20260806 18:44:24.632735 15459 fs_manager.cc:359] Metadata directory not provided
I20260806 18:44:24.632809 15459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 18:44:24.633272 15459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 18:44:24.635665 15459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data/instance:
uuid: "d03d436d4214409888456c4551576d66"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "48f0347fe68579a0643aef695898e802"
server_key_iv: "c86f6651a780485291e612b7638654e2"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.636332 15459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal/instance:
uuid: "d03d436d4214409888456c4551576d66"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "48f0347fe68579a0643aef695898e802"
server_key_iv: "c86f6651a780485291e612b7638654e2"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.640614 15459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 18:44:24.643560 15485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 18:44:24.645033 15459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 18:44:24.645195 15459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data,/tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal
uuid: "d03d436d4214409888456c4551576d66"
format_stamp: "Formatted at 2026-08-06 18:44:24 on dist-test-slave-j2vl"
server_key: "48f0347fe68579a0643aef695898e802"
server_key_iv: "c86f6651a780485291e612b7638654e2"
server_key_version: "encryptionkey@0"
I20260806 18:44:24.645327 15459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 18:44:24.656172 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 3
I20260806 18:44:24.657171 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.656831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33728)
0806 18:44:24.656993 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.657080 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 18:44:24.658064 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.657811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33734)
0806 18:44:24.657934 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.657993 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 18:44:24.658245 15326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.177.188:33935: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
I20260806 18:44:24.669198 15459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 18:44:24.673655 15459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 18:44:24.673928 15459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 18:44:24.680794 15448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 3
I20260806 18:44:24.681859 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.681446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33740)
0806 18:44:24.681678 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.681761 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.177.188:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260806 18:44:24.682147 15459 rpc_server.cc:307] RPC server started. Bound to: 127.12.177.188:33935
I20260806 18:44:24.682499 15569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.177.188:33935 every 8 connection(s)
I20260806 18:44:24.683447 15459 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/data/info.pb
I20260806 18:44:24.684280 12998 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9NHeiD/build/debug/bin/kudu as pid 15459
I20260806 18:44:24.684417 12998 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9NHeiD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786041540454168-12998-0/minicluster-data/master-2/wal/instance
I20260806 18:44:24.684746 12998 external_mini_cluster.cc:1428] Setting key 62da1e55ccaf538a4e10c54372b2c228
I20260806 18:44:24.687322 15571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.189@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
I20260806 18:44:24.692847 15571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.698050 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.682502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33748)
0806 18:44:24.682685 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.682701 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.682806 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.685947 (+ 3141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.685951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.686168 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.686296 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.686304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.687973 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.687978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.688762 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.688776 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.689790 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.689802 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.689897 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.690661 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.690680 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.692589 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.695405 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.695410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.695412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.695887 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.696357 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.696363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.696368 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.696497 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.697389 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.697393 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.697537 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.697660 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.697845 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 18:44:24.699847 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.685438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33752 (local address 127.12.177.188:33935)
0806 18:44:24.686528 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.686536 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.686548 (+ 12us) server_negotiation.cc:407] Connection header received
0806 18:44:24.686577 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.686579 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.686621 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.686722 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.687676 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.688278 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.689249 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.689684 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.689831 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.693457 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.693462 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.693466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.693499 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.696788 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.697408 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.697413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.697415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.697514 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.697849 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.697853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.697855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.698098 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.698303 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.698700 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.698822 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":1022,"thread_start_us":114,"threads_started":1}
I20260806 18:44:24.699862 15570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.683543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33748 (local address 127.12.177.188:33935)
0806 18:44:24.684120 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.684138 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.684178 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:24.685016 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.685036 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.685578 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.686000 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.686487 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.687820 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.688921 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.689653 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.689835 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.692876 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.692885 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.692908 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.692942 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.695241 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.696047 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.696053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.696060 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.696225 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.696606 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.696610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.696611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.697195 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.697393 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.697843 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.698539 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":421,"server-negotiator.queue_time_us":409,"thread_start_us":166,"threads_started":1}
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:24.706117 15448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: Bootstrap starting.
I20260806 18:44:24.707481 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.695507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56892 (local address 127.12.177.190:37085)
0806 18:44:24.695688 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.695694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.696190 (+ 496us) server_negotiation.cc:407] Connection header received
0806 18:44:24.696459 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.696464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.696532 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.696626 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.697555 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.698329 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.699440 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.699692 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.699814 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.703189 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.703196 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.703202 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.703237 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.704885 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.705453 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.705457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.705459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.705575 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.705929 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.705933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.705935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.706197 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.706290 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.706769 (+ 479us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.706913 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 18:44:24.707536 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.695432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.190:37085 (local address 127.0.0.1:56892)
0806 18:44:24.696061 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.696109 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.696259 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.696799 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.696806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.697203 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.697412 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.697422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.698433 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.698436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.699292 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.699303 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.699832 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.699836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.699976 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.701153 (+ 1177us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.701168 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.703008 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.705013 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.705025 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.705032 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.705294 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.705673 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.705676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.705678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.705789 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.706354 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.706360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.706512 (+ 152us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.706690 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.706922 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":167,"threads_started":1}
I20260806 18:44:24.708895 15571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.710269 15448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: Neither blocks nor log segments found. Creating new log.
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.190@KRBTEST.COM
I20260806 18:44:24.711382 15448 log.cc:824] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:24.714387 15448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: No bootstrap required, opened a new log
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
I20260806 18:44:24.717583 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.702992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56894 (local address 127.12.177.190:37085)
0806 18:44:24.703427 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.703442 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.703460 (+ 18us) server_negotiation.cc:407] Connection header received
0806 18:44:24.703502 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.703508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.703567 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.704521 (+ 954us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.704639 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.705483 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.706567 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.707381 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.708488 (+ 1107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.711419 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.711423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.711426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.711456 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.714289 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.714926 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.714929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.714931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.715027 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.715658 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.715662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.715664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.716178 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.717091 (+ 913us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.717178 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.717336 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":183,"threads_started":1}
I20260806 18:44:24.718643 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.709584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.12.177.189:38065)
0806 18:44:24.709705 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.709710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.709750 (+ 40us) server_negotiation.cc:407] Connection header received
0806 18:44:24.709924 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.709927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.709982 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.710080 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.710574 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.711161 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.712242 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.712597 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.712684 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.715082 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.715086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.715089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.715123 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.716526 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.717098 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.717102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.717104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.717190 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.717531 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.717535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.717537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.717840 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.718004 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.718355 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.718487 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:44:24.718751 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.709487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.189:38065 (local address 127.0.0.1:58822)
0806 18:44:24.709686 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.709702 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.709800 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.710097 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.710100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.710293 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.710446 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.710454 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.711285 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.711288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.712089 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.712102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.712841 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.712844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.712923 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.713382 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.713398 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.714923 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.716667 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.716672 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.716674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.717010 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.717292 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.717296 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.717298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.717423 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.718055 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.718058 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.718167 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.718273 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.718524 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260806 18:44:24.719586 15571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } has no permanent_uuid. Determining permanent_uuid...
I20260806 18:44:24.719525 15448 raft_consensus.cc:348] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.719795 15448 raft_consensus.cc:729] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e814187a8c484646af915053099294fe, State: Initialized, Role: FOLLOWER
I20260806 18:44:24.720196 15448 consensus_queue.cc:260] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.720808 15580 sys_catalog.cc:455] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.720960 15580 sys_catalog.cc:458] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.721786 15448 sys_catalog.cc:564] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.177.189@KRBTEST.COM
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.188@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
W20260806 18:44:24.727574 15598 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:24.727664 15598 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:24.730114 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.719611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58824 (local address 127.12.177.189:38065)
0806 18:44:24.719748 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.719752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.719939 (+ 187us) server_negotiation.cc:407] Connection header received
0806 18:44:24.719981 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.719987 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.720042 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.720117 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.721114 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.721932 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.723057 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.723263 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.723378 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.726432 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.726436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.726439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.726466 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.728080 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.728588 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.728591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.728593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.728681 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.728999 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.729003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.729005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.729238 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.729425 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.729822 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.729959 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 18:44:24.725962 15336 master_runner.cc:186] Error getting master registration for 127.12.177.190:37085: OK, instance_id { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" instance_seqno: 1786041864179900 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 18:44:24.731225 15336 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:24.732023 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.720339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33762 (local address 127.12.177.188:33935)
0806 18:44:24.720436 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.720441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.720464 (+ 23us) server_negotiation.cc:407] Connection header received
0806 18:44:24.720496 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.720499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.720531 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.720597 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.721108 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.721927 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.724449 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.724765 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.724844 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.727963 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.727966 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.727969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.727990 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.729737 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.730490 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.730494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.730496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.730585 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.730978 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.730981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.730982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.731302 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.731384 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.731756 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.731876 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 18:44:24.732483 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.720113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33762)
0806 18:44:24.720339 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.720352 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.720424 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.720702 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.720704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.720883 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.720982 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.720990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.723097 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.723103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.724313 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.724329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.724979 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.724982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.725059 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.725580 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.725595 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.727805 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.729862 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.729864 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.729866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.730105 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.730697 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.730699 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.730701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.730788 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.731503 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.731506 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.731591 (+ 85us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.731698 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.732363 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158}
I20260806 18:44:24.734241 12998 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 18:44:24.735483 15571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: Bootstrap starting.
I20260806 18:44:24.735476 15283 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "89838127cb3540a3b65b358a14f2aa15"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56894
I20260806 18:44:24.738020 15571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:24.738796 15571 log.cc:824] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:24.741434 15571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: No bootstrap required, opened a new log
I20260806 18:44:24.746079 15571 raft_consensus.cc:348] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.746412 15571 raft_consensus.cc:729] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03d436d4214409888456c4551576d66, State: Initialized, Role: FOLLOWER
I20260806 18:44:24.746855 15571 consensus_queue.cc:260] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.747578 15603 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.747752 15603 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.748525 15571 sys_catalog.cc:564] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 18:44:24.754933 15622 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:24.755055 15622 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:24.752961 15459 master_runner.cc:186] Error getting master registration for 127.12.177.190:37085: OK, instance_id { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" instance_seqno: 1786041864179900 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 18:44:24.756556 15459 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:24.822376 15326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } attempt: 4
Aug 06 18:44:24 dist-test-slave-j2vl krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786041864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.177.190@KRBTEST.COM for kudu/127.12.177.188@KRBTEST.COM
I20260806 18:44:24.834167 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.823123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.177.188:33935 (local address 127.0.0.1:33766)
0806 18:44:24.823367 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0806 18:44:24.823386 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 18:44:24.823502 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 18:44:24.824144 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 18:44:24.824148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 18:44:24.824375 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0806 18:44:24.824496 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.824503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.825580 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.825584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.826432 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 18:44:24.826444 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.827118 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.827122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 18:44:24.827212 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.827847 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 18:44:24.827861 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 18:44:24.829732 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 18:44:24.832134 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.832138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.832140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.832458 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.832819 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 18:44:24.832822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 18:44:24.832825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 18:44:24.832925 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 18:44:24.833522 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 18:44:24.833525 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 18:44:24.833649 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 18:44:24.833761 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 18:44:24.833942 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 18:44:24.834982 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.823690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33766 (local address 127.12.177.188:33935)
0806 18:44:24.823882 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.823887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.823906 (+ 19us) server_negotiation.cc:407] Connection header received
0806 18:44:24.823957 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.823960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.824014 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.824109 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.824634 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.825467 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.826595 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.826989 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.827120 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.829942 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.829947 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.829951 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.829985 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.831970 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.832595 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.832599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.832601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.832702 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.833044 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.833048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.833050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.833320 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.833465 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.834623 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.834803 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 18:44:24.839174 15326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: Bootstrap starting.
I20260806 18:44:24.842970 15326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: Neither blocks nor log segments found. Creating new log.
I20260806 18:44:24.844399 15326 log.cc:824] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: Log is configured to *not* fsync() on all Append() calls
I20260806 18:44:24.848347 15326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: No bootstrap required, opened a new log
I20260806 18:44:24.854840 15326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.855336 15326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89838127cb3540a3b65b358a14f2aa15, State: Initialized, Role: FOLLOWER
I20260806 18:44:24.855906 15326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.856710 15627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.856948 15627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.858317 15283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 18:44:24.858453 15283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:24.860628 15283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.860966 15326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 18:44:24.862509 15404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89838127cb3540a3b65b358a14f2aa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e814187a8c484646af915053099294fe"
I20260806 18:44:24.862800 15404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [term 0 FOLLOWER]: Advancing to term 1
I20260806 18:44:24.864603 15404 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89838127cb3540a3b65b358a14f2aa15 in term 1.
I20260806 18:44:24.865149 15283 leader_election.cc:288] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [CANDIDATE]: Term 1 election: Requested vote from peers e814187a8c484646af915053099294fe (127.12.177.189:38065), d03d436d4214409888456c4551576d66 (127.12.177.188:33935)
I20260806 18:44:24.865506 15248 leader_election.cc:302] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89838127cb3540a3b65b358a14f2aa15, e814187a8c484646af915053099294fe; no voters:
I20260806 18:44:24.866896 15627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 18:44:24.867136 15627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [term 1 LEADER]: Becoming Leader. State: Replica: 89838127cb3540a3b65b358a14f2aa15, State: Running, Role: LEADER
I20260806 18:44:24.867525 15627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } }
I20260806 18:44:24.867734 15529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89838127cb3540a3b65b358a14f2aa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d03d436d4214409888456c4551576d66"
I20260806 18:44:24.868021 15529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [term 0 FOLLOWER]: Advancing to term 1
W20260806 18:44:24.868530 15643 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 18:44:24.868711 15643 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 18:44:24.869719 15627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89838127cb3540a3b65b358a14f2aa15. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.869849 15627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:24.871846 15529 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89838127cb3540a3b65b358a14f2aa15 in term 1.
I20260806 18:44:24.876118 15213 master_runner.cc:263] No leader master found from master 89838127cb3540a3b65b358a14f2aa15
I20260806 18:44:24.876211 15213 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 18:44:24.876562 15657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 18:44:24.878151 15657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 18:44:24.884137 15529 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [term 1 FOLLOWER]: Refusing update from remote peer 89838127cb3540a3b65b358a14f2aa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:44:24.884929 15652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:44:24.889464 15603 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89838127cb3540a3b65b358a14f2aa15. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.889639 15603 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.891041 15404 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [term 1 FOLLOWER]: Refusing update from remote peer 89838127cb3540a3b65b358a14f2aa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 18:44:24.891849 15652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 18:44:24.896525 15580 sys_catalog.cc:455] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89838127cb3540a3b65b358a14f2aa15. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.896703 15580 sys_catalog.cc:458] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.903560 15627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.903728 15627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:24.903918 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.877471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58828 (local address 127.12.177.189:38065)
0806 18:44:24.877600 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.877605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.883455 (+ 5850us) server_negotiation.cc:407] Connection header received
0806 18:44:24.883648 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.883651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.883710 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.883766 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.884808 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.885658 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.897083 (+ 11425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.897492 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.897602 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.899411 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.899416 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.899419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.899454 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.901383 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.901975 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.901979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.901981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.902091 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.902422 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.902428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.902430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.902717 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.902840 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.903588 (+ 748us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.903738 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 18:44:24.904242 15580 sys_catalog.cc:455] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.904397 15580 sys_catalog.cc:458] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.904860 15663 mvcc.cc:205] Tried to move back new op lower bound from 7315627478557622272 to 7315627478501597184. Current Snapshot: MvccSnapshot[applied={T|T < 7315627478557622272}]
I20260806 18:44:24.907495 15667 mvcc.cc:205] Tried to move back new op lower bound from 7315627478557622272 to 7315627478501597184. Current Snapshot: MvccSnapshot[applied={T|T < 7315627478557622272}]
I20260806 18:44:24.908509 15627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.908651 15627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15 [sys.catalog]: This master's current role is: LEADER
I20260806 18:44:24.910193 15603 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "89838127cb3540a3b65b358a14f2aa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89838127cb3540a3b65b358a14f2aa15" member_type: VOTER last_known_addr { host: "127.12.177.190" port: 37085 } } peers { permanent_uuid: "e814187a8c484646af915053099294fe" member_type: VOTER last_known_addr { host: "127.12.177.189" port: 38065 } } peers { permanent_uuid: "d03d436d4214409888456c4551576d66" member_type: VOTER last_known_addr { host: "127.12.177.188" port: 33935 } } }
I20260806 18:44:24.910363 15603 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 18:44:24.910784 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.876707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56910 (local address 127.12.177.190:37085)
0806 18:44:24.876846 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.876852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.881703 (+ 4851us) server_negotiation.cc:407] Connection header received
0806 18:44:24.881924 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.881928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.881985 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.882040 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.886059 (+ 4019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.886764 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.891860 (+ 5096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.892268 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.892362 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.902152 (+ 9790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.902158 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.902161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.902199 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.904309 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.907525 (+ 3216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.907530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.907532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.907651 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.908136 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.908140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.908142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.908417 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.908585 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.910394 (+ 1809us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.910596 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 18:44:24.912147 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:24.877870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.12.177.188:33935)
0806 18:44:24.877982 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.877986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.884637 (+ 6651us) server_negotiation.cc:407] Connection header received
0806 18:44:24.884820 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.884823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.884878 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.884936 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.889481 (+ 4545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.890206 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.894667 (+ 4461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:24.895096 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:24.895195 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:24.904057 (+ 8862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 18:44:24.904067 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 18:44:24.904069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 18:44:24.904108 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 18:44:24.906331 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.908688 (+ 2357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.908693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.908695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.908804 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 18:44:24.909581 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 18:44:24.909586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 18:44:24.909587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 18:44:24.909835 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 18:44:24.909982 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:24.911832 (+ 1850us) server_negotiation.cc:299] Negotiation successful
0806 18:44:24.911984 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 18:44:24.913106 15664 mvcc.cc:205] Tried to move back new op lower bound from 7315627478557622272 to 7315627478501597184. Current Snapshot: MvccSnapshot[applied={T|T < 7315627478557622272}]
I20260806 18:44:24.917496 15657 catalog_manager.cc:1347] Generated new cluster ID: 38adbbc56c10400dbd7243f70dc96abb
I20260806 18:44:24.917594 15657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 18:44:24.939210 15657 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 18:44:24.940635 15657 catalog_manager.cc:1504] Loading token signing keys...
I20260806 18:44:24.956048 15657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89838127cb3540a3b65b358a14f2aa15: Generated new TSK 0
I20260806 18:44:24.957201 15657 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 18:44:24.984091 15577 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.982520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56916 (local address 127.12.177.190:37085)
0806 18:44:24.982680 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.982688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.982855 (+ 167us) server_negotiation.cc:407] Connection header received
0806 18:44:24.983036 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.983040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.983098 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.983155 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.983938 (+ 783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56916: BlockingRecv error: recv got EOF from 127.0.0.1:56916 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 18:44:24.984707 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.983091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.12.177.189:38065)
0806 18:44:24.983243 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.983248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.983509 (+ 261us) server_negotiation.cc:407] Connection header received
0806 18:44:24.983715 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.983718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.983774 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.983841 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.984581 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58830: BlockingRecv error: recv got EOF from 127.0.0.1:58830 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 18:44:24.984977 15575 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.983496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.12.177.188:33935)
0806 18:44:24.983637 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.983643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.983860 (+ 217us) server_negotiation.cc:407] Connection header received
0806 18:44:24.984044 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.984049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.984111 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.984167 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.984868 (+ 701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33794: BlockingRecv error: recv got EOF from 127.0.0.1:33794 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 18:44:24.988838 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.987390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58838 (local address 127.12.177.189:38065)
0806 18:44:24.987517 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.987520 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.987695 (+ 175us) server_negotiation.cc:407] Connection header received
0806 18:44:24.987837 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.987840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.987924 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.988009 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.988683 (+ 674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58838: BlockingRecv error: recv got EOF from 127.0.0.1:58838 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 18:44:24.993093 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.992137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.12.177.189:38065)
0806 18:44:24.992283 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.992287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.992301 (+ 14us) server_negotiation.cc:407] Connection header received
0806 18:44:24.992352 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.992354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.992404 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.992525 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.992964 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58844: BlockingRecv error: recv got EOF from 127.0.0.1:58844 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 18:44:24.998888 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:24.997534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58850 (local address 127.12.177.189:38065)
0806 18:44:24.997686 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:24.997691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:24.997869 (+ 178us) server_negotiation.cc:407] Connection header received
0806 18:44:24.998007 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:24.998010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:24.998059 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:24.998123 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:24.998697 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58850: BlockingRecv error: recv got EOF from 127.0.0.1:58850 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 18:44:25.006255 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.004939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58856 (local address 127.12.177.189:38065)
0806 18:44:25.005081 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.005087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.005278 (+ 191us) server_negotiation.cc:407] Connection header received
0806 18:44:25.005445 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.005448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.005500 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.005574 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.006124 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58856: BlockingRecv error: recv got EOF from 127.0.0.1:58856 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 18:44:25.018309 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.016899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58872 (local address 127.12.177.189:38065)
0806 18:44:25.017072 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.017080 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.017284 (+ 204us) server_negotiation.cc:407] Connection header received
0806 18:44:25.017454 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.017457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.017513 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.017596 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.018163 (+ 567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58872: BlockingRecv error: recv got EOF from 127.0.0.1:58872 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 18:44:25.038467 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.037098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.12.177.189:38065)
0806 18:44:25.037266 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.037272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.037470 (+ 198us) server_negotiation.cc:407] Connection header received
0806 18:44:25.037607 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.037612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.037679 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.037795 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.038336 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58886: BlockingRecv error: recv got EOF from 127.0.0.1:58886 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 18:44:25.074257 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.072886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58894 (local address 127.12.177.189:38065)
0806 18:44:25.073036 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.073041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.073186 (+ 145us) server_negotiation.cc:407] Connection header received
0806 18:44:25.073317 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.073321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.073418 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.073527 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.074097 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58894: BlockingRecv error: recv got EOF from 127.0.0.1:58894 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 18:44:25.142238 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.140760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58908 (local address 127.12.177.189:38065)
0806 18:44:25.140966 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.140971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.141125 (+ 154us) server_negotiation.cc:407] Connection header received
0806 18:44:25.141331 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.141334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.141421 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.141519 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.142045 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58908: BlockingRecv error: recv got EOF from 127.0.0.1:58908 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260806 18:44:25.274277 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.272875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.12.177.189:38065)
0806 18:44:25.273038 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.273042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.273235 (+ 193us) server_negotiation.cc:407] Connection header received
0806 18:44:25.273310 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.273313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.273449 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.273532 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.274158 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40318: BlockingRecv error: recv got EOF from 127.0.0.1:40318 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 18:44:25.534073 15450 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 18:44:25.532998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40330 (local address 127.12.177.189:38065)
0806 18:44:25.533159 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:25.533162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:25.533179 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:44:25.533242 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:25.533244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:25.533295 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:25.533457 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 18:44:25.533963 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40330: BlockingRecv error: recv got EOF from 127.0.0.1:40330 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 18:44:25.729139 15598 catalog_manager.cc:1259] Loaded cluster ID: 38adbbc56c10400dbd7243f70dc96abb
I20260806 18:44:25.729245 15598 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: loading cluster ID for follower catalog manager: success
I20260806 18:44:25.731093 15598 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: acquiring CA information for follower catalog manager: success
I20260806 18:44:25.732489 15598 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e814187a8c484646af915053099294fe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:44:25.756616 15622 catalog_manager.cc:1259] Loaded cluster ID: 38adbbc56c10400dbd7243f70dc96abb
I20260806 18:44:25.756712 15622 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: loading cluster ID for follower catalog manager: success
I20260806 18:44:25.758489 15622 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: acquiring CA information for follower catalog manager: success
I20260806 18:44:25.759737 15622 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d03d436d4214409888456c4551576d66: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 18:44:26.053417 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:26.048695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40346 (local address 127.12.177.189:38065)
0806 18:44:26.049022 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:26.049029 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:26.049064 (+ 35us) server_negotiation.cc:407] Connection header received
0806 18:44:26.049410 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:26.049413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:26.049562 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:26.049721 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:26.050188 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.050757 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.051636 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.051901 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.052087 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:26.052373 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:26.052879 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:26.052978 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:26.053117 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 18:44:26.053179 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":114,"threads_started":1}
I20260806 18:44:26.061295 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:26.057221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.12.177.188:33935)
0806 18:44:26.057527 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:26.057532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:26.057554 (+ 22us) server_negotiation.cc:407] Connection header received
0806 18:44:26.057643 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:26.057646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:26.057774 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:26.057911 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:26.058159 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.058712 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.059586 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.059830 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.059946 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:26.060295 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:26.060847 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:26.060987 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:26.061052 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 18:44:26.061119 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":80,"threads_started":1}
I20260806 18:44:26.070317 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:26.066505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40574 (local address 127.12.177.188:33935)
0806 18:44:26.066637 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:26.066641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:26.066903 (+ 262us) server_negotiation.cc:407] Connection header received
0806 18:44:26.066997 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:26.067000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:26.067054 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:26.067129 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:26.067496 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.068031 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.068957 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.069310 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.069454 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:26.069730 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:26.069811 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:26.069857 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:26.070051 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 18:44:26.070128 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 18:44:26.070514 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:26.065426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.12.177.190:37085)
0806 18:44:26.065709 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:26.065714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:26.065731 (+ 17us) server_negotiation.cc:407] Connection header received
0806 18:44:26.065901 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:26.065908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:26.066128 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:26.066264 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:26.066544 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.067293 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.068482 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.068873 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.068991 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:26.069457 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:26.069869 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:26.069976 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:26.070257 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 18:44:26.070334 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260806 18:44:26.070645 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 18:44:26.065838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.12.177.189:38065)
0806 18:44:26.066017 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 18:44:26.066022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 18:44:26.066337 (+ 315us) server_negotiation.cc:407] Connection header received
0806 18:44:26.066571 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 18:44:26.066577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 18:44:26.066645 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 18:44:26.066699 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 18:44:26.067155 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.067907 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.069095 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 18:44:26.069488 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 18:44:26.069615 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 18:44:26.069887 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 18:44:26.069965 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 18:44:26.070051 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 18:44:26.070442 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 18:44:26.070508 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 18:44:26.076234 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15213
I20260806 18:44:26.095024 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15336
I20260806 18:44:26.112412 12998 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9NHeiD/build/debug/bin/kudu with pid 15459
2026-08-06T18:44:26Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3581 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7159 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (325651 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST